-- Logs begin at Tue 2022-10-11 11:20:07 UTC, end at Tue 2022-10-11 12:14:31 UTC. -- Oct 11 11:45:18.886636 dv-cinder-820994-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 11 11:45:18.897560 dv-cinder-820994-6-smb devstack@keystone.service[81378]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 11:45:18 2022] *** Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: nodename: dv-cinder-820994-6-smb Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: machine: x86_64 Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: clock source: unix Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: pcre jit disabled Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: detected number of CPU cores: 4 Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: current working directory: / Oct 11 11:45:18.899636 dv-cinder-820994-6-smb devstack@keystone.service[81378]: detected binary path: /usr/bin/uwsgi-core Oct 11 11:45:18.900138 dv-cinder-820994-6-smb devstack@keystone.service[81378]: your processes number limit is 47680 Oct 11 11:45:18.900138 dv-cinder-820994-6-smb devstack@keystone.service[81378]: your memory page size is 4096 bytes Oct 11 11:45:18.900138 dv-cinder-820994-6-smb devstack@keystone.service[81378]: detected max file descriptor number: 2048 Oct 11 11:45:18.900138 dv-cinder-820994-6-smb devstack@keystone.service[81378]: lock engine: pthread robust mutexes Oct 11 11:45:18.900138 dv-cinder-820994-6-smb devstack@keystone.service[81378]: thunder lock: enabled Oct 11 11:45:18.900138 dv-cinder-820994-6-smb devstack@keystone.service[81378]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 11 11:45:18.900138 dv-cinder-820994-6-smb devstack@keystone.service[81378]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 11:45:18.938959 dv-cinder-820994-6-smb devstack@keystone.service[81378]: Python main interpreter initialized at 0x55b7646249c0 Oct 11 11:45:18.938959 dv-cinder-820994-6-smb devstack@keystone.service[81378]: python threads support enabled Oct 11 11:45:18.938959 dv-cinder-820994-6-smb devstack@keystone.service[81378]: your server socket listen backlog is limited to 100 connections Oct 11 11:45:18.938959 dv-cinder-820994-6-smb devstack@keystone.service[81378]: your mercy for graceful operations on workers is 90 seconds Oct 11 11:45:18.939358 dv-cinder-820994-6-smb devstack@keystone.service[81378]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 11:45:18.939358 dv-cinder-820994-6-smb devstack@keystone.service[81378]: *** Operational MODE: preforking *** Oct 11 11:45:18.939669 dv-cinder-820994-6-smb devstack@keystone.service[81378]: *** uWSGI is running in multiple interpreter mode *** Oct 11 11:45:18.939669 dv-cinder-820994-6-smb devstack@keystone.service[81378]: spawned uWSGI master process (pid: 81378) Oct 11 11:45:18.939895 dv-cinder-820994-6-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 11 11:45:18.946590 dv-cinder-820994-6-smb devstack@keystone.service[81378]: spawned uWSGI worker 1 (pid: 81390, cores: 1) Oct 11 11:45:18.946590 dv-cinder-820994-6-smb devstack@keystone.service[81378]: spawned uWSGI worker 2 (pid: 81391, cores: 1) Oct 11 11:45:18.946590 dv-cinder-820994-6-smb devstack@keystone.service[81378]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 11:45:23.213836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:45:23.213836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: from cryptography.utils import int_from_bytes Oct 11 11:45:23.214691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:45:23.214691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: from cryptography.utils import int_from_bytes Oct 11 11:45:23.215097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:45:23.215097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: from cryptography.utils import int_from_bytes Oct 11 11:45:23.215199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:45:23.215199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: from cryptography.utils import int_from_bytes Oct 11 11:45:23.267510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 11:45:23.267700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 11:45:23.267780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] command line args: [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 11:45:23.268029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 11:45:23.268158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ================================================================================ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 11:45:23.268443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] admin_token = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.268687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config_dir = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.268813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 11:45:23.268896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.268961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 11:45:23.269024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] config_source = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.269090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] command line args: [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 11:45:23.269152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] debug = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.269302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 11:45:23.269379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.269673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ================================================================================ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 11:45:23.269673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] admin_token = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.269794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.269900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.269969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config_dir = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] config_source = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] debug = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_config_append = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.270921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_dir = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_config_append = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.271964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_dir = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.272960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.273860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.274899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] publish_errors = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.275991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276208 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] publish_errors = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] standard_threads = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.276911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_journal = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_json = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] standard_threads = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_stderr = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] use_syslog = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.277965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.278065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.278150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.278230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_journal = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.278376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.278506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_json = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.278607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_stderr = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.278679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.278747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] use_syslog = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.278870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.278955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:45:23.279140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.279260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.279336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.279442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.279573 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.279708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.279818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.279901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280744 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.280813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.281890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.282910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.283871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284469 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.284940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.285938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.286879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.287995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.288878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289112 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.289937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.290941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.291989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.292918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.293029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.293110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.293220 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.293699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.293776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.293930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.294966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.295892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296580 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.297948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.298971 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.299890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.300941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301015 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301838 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.301912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.302883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.external = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.303956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.password = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.external = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] auth.token = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.304942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.password = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] auth.token = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.305881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306249 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.306975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.307991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.308922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309571 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.309970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.310912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311290 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.311989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.312931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.313926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314536 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.314929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.315957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.316951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.317890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.318984 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.319982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.320896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.321962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.322038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.322184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.322259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.322417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.322539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.322671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.322808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.323970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.324961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.324961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.324961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.324961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.325213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.325282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.325352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.325494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.325576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.325823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.325897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326536 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.326876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.327939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.328974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.329912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.330859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331554 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.331945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332249 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.332944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.333868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.334987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.335984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.336907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337553 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.337855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.338985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339453 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.339944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.340911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.341868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342323 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342760 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.342990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.343944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.344978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.345997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.346934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347553 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.347859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.348979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349668 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.349966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.350939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351560 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.351865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.352861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 11:45:23.352936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.353135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.353371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.353599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.353835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.354061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.354299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.354526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.354784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.355010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.355242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.355471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:45:23.355639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 11:45:23.385016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.385236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.385444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.387167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.387398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.387622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.394438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.396253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.422954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.423240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.424564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.424758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.475775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.476161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.523157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.523303 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.523794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.524021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.681408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.681706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.681916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.682630 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.705301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.705598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.705697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.705868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.706951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.717988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.718136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.730708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.730869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.730966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731553 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.731946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.732021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.732139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 11 11:45:23.748591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.748761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 11:45:23.749120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.749243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.749324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 11:45:23.749421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 11:45:23.749538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.749623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.749791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.749882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 11 11:45:23.750073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.750198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.750278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.750340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.750586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.750845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.759792 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.760067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.760298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.760488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.760617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.760789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.761052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.761330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.767696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.768450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.770545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.770849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.771125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.771378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.771501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.771640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.771778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.771901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.772905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.773031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.773153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.773319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.773489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.773784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.774060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.795827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.796940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.797271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.797551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.798404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.798715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.802200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.802479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.802773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.803334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.803616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.803892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.808986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.809251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.810149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.810468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.815027 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.815327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.815611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.815898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.816169 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.816317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.816402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.816591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.816714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.816883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.817020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.817164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.817432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.817710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.817985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.818250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.832300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.832569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.833543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.833825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.836385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.837602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.839577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.839867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.840790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.841109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.844023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.845243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.847140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.848316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.850308 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.850587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.850892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.851165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.851435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.851557 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.851761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.851851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.852060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.852335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.852618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.852881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.867246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.867524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.867791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.868051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.868449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.868740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.869004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.869266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.874787 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.876118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.876292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.877653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.877778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.878058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.879200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.879476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.880750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.881028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.881300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.881629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.881948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.882199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.882491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.882798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.883081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.883463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.893005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.893277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.893560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.893864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.894207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.894488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.894632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.894760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.894839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.895115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.895398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.895780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.896068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.896358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.909893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.911560 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.912774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.914432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.915679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.917101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.917295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.918904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.919106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.919272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.919612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.920635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.920914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.921319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.925835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.927298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.927660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.929094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.930147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.930540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.930846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.931120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.931984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.932379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.932662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.932935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.938837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.939126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.939403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.940696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.940984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.941259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.946121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.946403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.946706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.947004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.947215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.947510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.947774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.948050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.948173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 11 11:45:23.948296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.948387 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.948580 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.948718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.948848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.948947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.949150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.949288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.949405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.949492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.949699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.949823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.949956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.950203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.950542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.950845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.951115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.951381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.951651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 11 11:45:23.983434 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b7646249c0 pid: 81391 (default app) Oct 11 11:45:23.985388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b7646249c0 pid: 81390 (default app) Oct 11 11:45:23.986945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891764cc-5d89-47a4-a0ba-6912e4bef033 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:23.987217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891764cc-5d89-47a4-a0ba-6912e4bef033 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:23.987493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891764cc-5d89-47a4-a0ba-6912e4bef033 None None] PATH_INFO: `/v3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:23.991671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue Oct 11 11:45:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:30.739380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9185ff0-94a5-4ac6-96d0-739cf35e0930 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:30.739991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9185ff0-94a5-4ac6-96d0-739cf35e0930 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:30.739991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9185ff0-94a5-4ac6-96d0-739cf35e0930 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:30.744222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:45:30.750699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:30.751283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:30.751283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:30.822540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: INFO dbcounter [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] Registered counter for database keystone Oct 11 11:45:30.843384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG oslo_db.sqlalchemy.engines [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:45:30.851476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writer thread running {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:45:31.040391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG passlib.handlers.bcrypt [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81391) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 11 11:45:31.040689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG passlib.handlers.bcrypt [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81391) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 11 11:45:31.100808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:31.102424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:31.236058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 11 11:45:31.535003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9185ff0-94a5-4ac6-96d0-739cf35e0930 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:31.604187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: INFO dbcounter [None req-d9185ff0-94a5-4ac6-96d0-739cf35e0930 None None] Registered counter for database keystone Oct 11 11:45:31.625800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG oslo_db.sqlalchemy.engines [None req-d9185ff0-94a5-4ac6-96d0-739cf35e0930 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:45:31.633256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writer thread running {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:45:31.752359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9185ff0-94a5-4ac6-96d0-739cf35e0930 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:31.758065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc10f27-c42d-4e5b-8e8c-e4ed80aa5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:31.758743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10f27-c42d-4e5b-8e8c-e4ed80aa5ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:31.759019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10f27-c42d-4e5b-8e8c-e4ed80aa5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:31.759277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc10f27-c42d-4e5b-8e8c-e4ed80aa5ce3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:31.768694 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc10f27-c42d-4e5b-8e8c-e4ed80aa5ce3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:31.819687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING keystone.common.rbac_enforcer.enforcer [None req-acc10f27-c42d-4e5b-8e8c-e4ed80aa5ce3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 11 11:45:31.819951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc10f27-c42d-4e5b-8e8c-e4ed80aa5ce3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:31.829680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 11 11:45:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 11:45:31.835874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:31.853361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609490f-6223-40ef-bf74-f809462461d0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:31.858341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f63b8-153a-4013-82e3-5df42bed7393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:31.859480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f63b8-153a-4013-82e3-5df42bed7393 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:31.859755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f63b8-153a-4013-82e3-5df42bed7393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:31.860019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f63b8-153a-4013-82e3-5df42bed7393 admin admin] PATH_INFO: `/v3/projects/be0e0b74041048e6a742ee9441a4f3f2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:31.861655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f63b8-153a-4013-82e3-5df42bed7393 admin admin] RBAC: Authorizing `identity:get_project(project_id=be0e0b74041048e6a742ee9441a4f3f2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:31.913829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING keystone.common.rbac_enforcer.enforcer [None req-724f63b8-153a-4013-82e3-5df42bed7393 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 11 11:45:31.914168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f63b8-153a-4013-82e3-5df42bed7393 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:31.919200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 11 11:45:31 2022] GET /identity/v3/projects/be0e0b74041048e6a742ee9441a4f3f2 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:45:34.040069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe00a8-2545-4b40-be4c-9352df0bec12 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:34.040633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe00a8-2545-4b40-be4c-9352df0bec12 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:34.040633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe00a8-2545-4b40-be4c-9352df0bec12 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:34.045186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:34.051459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317d6e-9305-4b2e-bf47-cf9bcfe75fc5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:34.051952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317d6e-9305-4b2e-bf47-cf9bcfe75fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:34.051952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16317d6e-9305-4b2e-bf47-cf9bcfe75fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:34.074080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-16317d6e-9305-4b2e-bf47-cf9bcfe75fc5 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:34.075702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-16317d6e-9305-4b2e-bf47-cf9bcfe75fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:34.085276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 11:45:34.347239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe00a8-2545-4b40-be4c-9352df0bec12 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:34.360854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe00a8-2545-4b40-be4c-9352df0bec12 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:34.365580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d90e0a-0bd5-46fb-9e30-bf449bfaa217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:34.366185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d90e0a-0bd5-46fb-9e30-bf449bfaa217 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:34.366459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d90e0a-0bd5-46fb-9e30-bf449bfaa217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:34.366760 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d90e0a-0bd5-46fb-9e30-bf449bfaa217 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:34.374674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d90e0a-0bd5-46fb-9e30-bf449bfaa217 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:34.376449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d90e0a-0bd5-46fb-9e30-bf449bfaa217 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:34.385358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 11 11:45:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 11:45:34.391458 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16317d6e-9305-4b2e-bf47-cf9bcfe75fc5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:34.401177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16317d6e-9305-4b2e-bf47-cf9bcfe75fc5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:34.406925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19b206-3c2e-42dd-ae59-ab1dca2461f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:34.407562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b206-3c2e-42dd-ae59-ab1dca2461f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:34.407842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b206-3c2e-42dd-ae59-ab1dca2461f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:34.408108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19b206-3c2e-42dd-ae59-ab1dca2461f1 admin admin] PATH_INFO: `/v3/users/0c6f9a858cab4edb80d37349ae653b91` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:34.409591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19b206-3c2e-42dd-ae59-ab1dca2461f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=0c6f9a858cab4edb80d37349ae653b91)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:34.411510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19b206-3c2e-42dd-ae59-ab1dca2461f1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:34.413123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 11 11:45:34 2022] GET /identity/v3/users/0c6f9a858cab4edb80d37349ae653b91 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:36.626403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112c5a3-545f-4da2-a7f3-ce3491601cf4 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:36.627007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112c5a3-545f-4da2-a7f3-ce3491601cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:36.627007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112c5a3-545f-4da2-a7f3-ce3491601cf4 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:36.628380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:45:36.634367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626c435-444a-4b70-adcb-8fcbbb7854ae None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:36.635052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626c435-444a-4b70-adcb-8fcbbb7854ae None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:36.635052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626c435-444a-4b70-adcb-8fcbbb7854ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:36.654879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7626c435-444a-4b70-adcb-8fcbbb7854ae None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:36.656120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7626c435-444a-4b70-adcb-8fcbbb7854ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:36.695778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3196754-6d65-4348-8783-7130a6fa60f8 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:36.696099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3196754-6d65-4348-8783-7130a6fa60f8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:36.696604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3196754-6d65-4348-8783-7130a6fa60f8 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:36.698308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:45:36.704467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:36.704746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:36.705016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:36.749892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG passlib.handlers.bcrypt [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81390) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 11 11:45:36.750308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG passlib.handlers.bcrypt [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81390) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 11 11:45:36.752284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:36.799421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:36.801040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:36.919279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:45:37.025100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626c435-444a-4b70-adcb-8fcbbb7854ae None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.052972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:37.148099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626c435-444a-4b70-adcb-8fcbbb7854ae None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:37.182524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.189638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:37.190374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:37.190762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:37.191108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:37.205837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:45:37.216999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:37.219111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:45:37.220567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:45:37.225262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.293958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012d61f-e4a5-473d-af3a-4044f901af01 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:37.296648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:37.341727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:37.342694 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:37.343106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:37.343379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:37.344381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:37.345710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:37.345871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:37.358956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.sql.core [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 11:45:37.358956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 11:45:37.358956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [parameters: {'id': 'a5d37fb233094fa581e83dab7e455e67', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 11:45:37.358956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 11:45:37.376864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc24a8c-7ae0-4614-977e-20382c575aa4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:45:37.377562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 11:45:37.378491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application yield resource Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise self.value Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application session.commit() Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 11:45:37.379427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.flush() Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application compat.raise_( Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 11:45:37.380427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 11:45:37.381631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:45:37.383547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [parameters: {'id': 'a5d37fb233094fa581e83dab7e455e67', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 11:45:37.384728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:37.385435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.386269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 8/15] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Oct 11 11:45:37 2022] POST /identity/v3/domains => generated 190 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:45:37.389097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.432284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:37.433311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:37.433697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:37.434141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:37.435208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:37.435671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:37.439358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:37.459102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:45:37.465835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.531116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3c1a6-929f-40d6-bcca-8f2fed00ccf9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:37.568037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:37.568978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:37.569257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:37.569528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:37.590135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:37.591844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:45:37.609731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:37.611447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:45:37.613282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:45:37.613282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:45:37.613282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:37.613282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:45:37.618016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.630652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c93e5-886a-402e-8375-9c8234a6a4a4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:37.660702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:37.679831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:37.680864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:37.681220 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:37.681581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] PATH_INFO: `/v3/users/0c6f9a858cab4edb80d37349ae653b91` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:37.683109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=0c6f9a858cab4edb80d37349ae653b91)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:37.685521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:37.687615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:45:37 2022] GET /identity/v3/users/0c6f9a858cab4edb80d37349ae653b91 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:37.693658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.710511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:37.772257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f35476-3f56-49b5-a6e3-bb02c742a663 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:37.815302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:37.815588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b866e7d-e169-4c25-9a2e-ce40ab597fe5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:37.815967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:37.816247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:37.816544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:37.817258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:37.817563 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:37.819126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:37.838517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:37.854320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536445a-449d-4629-981e-726034be4976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:37.855082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536445a-449d-4629-981e-726034be4976 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:37.855338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536445a-449d-4629-981e-726034be4976 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:37.855644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536445a-449d-4629-981e-726034be4976 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:37.857009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536445a-449d-4629-981e-726034be4976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:37.859065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536445a-449d-4629-981e-726034be4976 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:37.860796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:45:37.867555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:37.964944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:37.989923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774fc77-a030-4e2d-b37b-38fabafdf01d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:38.030939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098856b8-3adb-42f7-bc09-ba517ab60137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:38.031623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098856b8-3adb-42f7-bc09-ba517ab60137 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:38.031915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098856b8-3adb-42f7-bc09-ba517ab60137 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:38.032162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098856b8-3adb-42f7-bc09-ba517ab60137 None admin] PATH_INFO: `/v3/domains/default/users/0c6f9a858cab4edb80d37349ae653b91/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:38.034422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098856b8-3adb-42f7-bc09-ba517ab60137 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0c6f9a858cab4edb80d37349ae653b91, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:38.035918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098856b8-3adb-42f7-bc09-ba517ab60137 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:38.155816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 11/21] 10.222.0.48 () {58 vars in 1361 bytes} [Tue Oct 11 11:45:37 2022] PUT /identity/v3/domains/default/users/0c6f9a858cab4edb80d37349ae653b91/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:45:40.922018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b0f15-aa25-483b-98f3-a1e382115bf5 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:40.922883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b0f15-aa25-483b-98f3-a1e382115bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:40.922883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b0f15-aa25-483b-98f3-a1e382115bf5 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:40.924236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:45:40.930836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1219a-f552-43a9-a76f-b256a0216842 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:40.931637 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1219a-f552-43a9-a76f-b256a0216842 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:40.931637 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1219a-f552-43a9-a76f-b256a0216842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:40.961446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-41d1219a-f552-43a9-a76f-b256a0216842 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:40.963099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-41d1219a-f552-43a9-a76f-b256a0216842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:41.081045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:45:41.204383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46682f-57c5-4475-acee-0f0c5b8c3a35 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:41.204552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46682f-57c5-4475-acee-0f0c5b8c3a35 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:41.204831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46682f-57c5-4475-acee-0f0c5b8c3a35 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:41.206239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:45:41.216962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc26d-60df-406c-a6d3-af38afe3cf68 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:41.217273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc26d-60df-406c-a6d3-af38afe3cf68 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:41.217521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cc26d-60df-406c-a6d3-af38afe3cf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:41.240253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cc6cc26d-60df-406c-a6d3-af38afe3cf68 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:41.241540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cc6cc26d-60df-406c-a6d3-af38afe3cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:41.343661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:41.349912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:41.746998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46682f-57c5-4475-acee-0f0c5b8c3a35 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:41.873488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:41.902589 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc26d-60df-406c-a6d3-af38afe3cf68 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:41.927306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46682f-57c5-4475-acee-0f0c5b8c3a35 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:42.033279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f49292-a395-4983-babe-0556fd714a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:42.033841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49292-a395-4983-babe-0556fd714a02 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.034128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49292-a395-4983-babe-0556fd714a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.034399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49292-a395-4983-babe-0556fd714a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.035160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f49292-a395-4983-babe-0556fd714a02 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:42.036624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f49292-a395-4983-babe-0556fd714a02 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:42.152442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cc26d-60df-406c-a6d3-af38afe3cf68 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:42.187093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 13/26] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Oct 11 11:45:41 2022] POST /identity/v3/roles => generated 225 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:45:42.189119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700458-7058-4a11-93d8-5297e99da336 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.189621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700458-7058-4a11-93d8-5297e99da336 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.190085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5700458-7058-4a11-93d8-5297e99da336 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.192036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:42.204273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3f889-c008-40c5-8d2d-7d27b933c2fb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.205248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3f889-c008-40c5-8d2d-7d27b933c2fb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.207316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3f889-c008-40c5-8d2d-7d27b933c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.235233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:42.236303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.237685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.238172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.247073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fea3f889-c008-40c5-8d2d-7d27b933c2fb None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:42.257410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fea3f889-c008-40c5-8d2d-7d27b933c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:42.263446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:42.265250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:45:42.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:42.291784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:45:42.292581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:45:42.292581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:45:42.292581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:42.300134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 14/28] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:45:42.306959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:42.439206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:42.474252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:42.563822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951c24f-a382-427c-86d5-3102cd7e76b9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:42.626082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0edc97-642d-4310-a844-05a4117d84c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:42.626800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edc97-642d-4310-a844-05a4117d84c9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.627083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edc97-642d-4310-a844-05a4117d84c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.627363 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0edc97-642d-4310-a844-05a4117d84c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.628093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0edc97-642d-4310-a844-05a4117d84c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:42.628402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0edc97-642d-4310-a844-05a4117d84c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:42.629910 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0edc97-642d-4310-a844-05a4117d84c9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:42.655616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 15/30] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:45:42.662999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3f889-c008-40c5-8d2d-7d27b933c2fb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:42.758475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f40d-9301-49dd-a534-7c718a1364f9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.759332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f40d-9301-49dd-a534-7c718a1364f9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.759885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f40d-9301-49dd-a534-7c718a1364f9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.761688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 16/31] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:45:42.770766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f714457-c66b-494a-9ea7-8d89aa362a46 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.771416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f714457-c66b-494a-9ea7-8d89aa362a46 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.771892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f714457-c66b-494a-9ea7-8d89aa362a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.807209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:42.810458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2f714457-c66b-494a-9ea7-8d89aa362a46 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:42.812199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2f714457-c66b-494a-9ea7-8d89aa362a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:42.890277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3f889-c008-40c5-8d2d-7d27b933c2fb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:42.964403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963029-cac4-49ea-aa73-f013906b6d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:42.965764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963029-cac4-49ea-aa73-f013906b6d28 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:42.966050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963029-cac4-49ea-aa73-f013906b6d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:42.966324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963029-cac4-49ea-aa73-f013906b6d28 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:42.967065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963029-cac4-49ea-aa73-f013906b6d28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:42.968708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963029-cac4-49ea-aa73-f013906b6d28 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:42.983535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 17/32] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:45:42.984392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f714457-c66b-494a-9ea7-8d89aa362a46 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:43.032828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 16/33] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:45:42 2022] POST /identity/v3/projects => generated 301 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:45:43.032828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cb14d-5253-41cc-a7be-e39c86fe3581 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.032828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cb14d-5253-41cc-a7be-e39c86fe3581 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.032828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cb14d-5253-41cc-a7be-e39c86fe3581 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.036367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 17/34] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:43.037862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30eb6-1e2b-494b-b467-910e6dad6ed4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.038156 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30eb6-1e2b-494b-b467-910e6dad6ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.038425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30eb6-1e2b-494b-b467-910e6dad6ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.059132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:43.063414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8cd30eb6-1e2b-494b-b467-910e6dad6ed4 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:43.065160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8cd30eb6-1e2b-494b-b467-910e6dad6ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:43.202660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 18/35] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:43.219364 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f714457-c66b-494a-9ea7-8d89aa362a46 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:43.281087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96104b7b-2b3c-4be5-b21c-f672b285976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:43.282137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96104b7b-2b3c-4be5-b21c-f672b285976d None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.282643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96104b7b-2b3c-4be5-b21c-f672b285976d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.283105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96104b7b-2b3c-4be5-b21c-f672b285976d None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.284048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96104b7b-2b3c-4be5-b21c-f672b285976d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:43.285722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96104b7b-2b3c-4be5-b21c-f672b285976d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:43.312716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 18/36] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Oct 11 11:45:42 2022] POST /identity/v3/roles => generated 219 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:45:43.322716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f81d-5abd-4ae6-a740-5724fcf566df None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.323080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f81d-5abd-4ae6-a740-5724fcf566df None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.323276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740f81d-5abd-4ae6-a740-5724fcf566df None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.324658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 19/37] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:43.333078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5380d34-90bb-4961-a090-ccc5c8a064a0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.333782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5380d34-90bb-4961-a090-ccc5c8a064a0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.334248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5380d34-90bb-4961-a090-ccc5c8a064a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.355728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f5380d34-90bb-4961-a090-ccc5c8a064a0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:43.357572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f5380d34-90bb-4961-a090-ccc5c8a064a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:43.461740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 19/38] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:43.533868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740f81d-5abd-4ae6-a740-5724fcf566df None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:43.558339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5380d34-90bb-4961-a090-ccc5c8a064a0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:43.602408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:43.626147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:43.690095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740f81d-5abd-4ae6-a740-5724fcf566df None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:43.690413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5380d34-90bb-4961-a090-ccc5c8a064a0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:43.725351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:43.725903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.726225 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.726443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.728786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:43.729503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.729779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.730045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.730757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:43.732352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:43.736981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:45:43.742847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:43.743776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:45:43.744751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 20/39] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:45:43.749825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:43.754753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Oct 11 11:45:43 2022] POST /identity/v3/roles => generated 223 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:45:43.800566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:43.873409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6eeeb7-84f0-468e-abe5-6376d6057b90 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:43.890116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:43.906109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:43.917676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea2bce-aa5c-434e-a641-3bb7917f3df6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:43.924295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:43.924937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.925264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.925604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.927045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:43.927359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:43.929693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:43.941151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 21/41] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:45:43.947466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:43.958246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:43.959008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:43.959289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:43.959593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:43.961847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:43.962438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:43.964935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 21/42] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:45:43.971423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:44.069006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6fee8-ec2b-4f5b-b62d-2110a550b6c8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:44.078048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa615-1c54-47e6-907e-49ac20e248ab None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:44.104540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:44.105196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:44.105530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:44.105798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] PATH_INFO: `/v3/users/0c6f9a858cab4edb80d37349ae653b91` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:44.107063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] RBAC: Authorizing `identity:get_user(user_id=0c6f9a858cab4edb80d37349ae653b91)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:44.108530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:44.110143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:45:43 2022] GET /identity/v3/users/0c6f9a858cab4edb80d37349ae653b91 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:44.113781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:44.114409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:44.114787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:44.115061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:44.115589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:44.115731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:44.117167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:44.146970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 22/44] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:45:43 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:45:44.160740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:44.223834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f0da9-bdef-4eaa-9ede-3c8cd5d7cdd0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:44.261102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02b571-a2f3-4c10-817e-f719b0af6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:44.261678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02b571-a2f3-4c10-817e-f719b0af6527 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:44.261961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02b571-a2f3-4c10-817e-f719b0af6527 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:44.262256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02b571-a2f3-4c10-817e-f719b0af6527 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:44.263605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02b571-a2f3-4c10-817e-f719b0af6527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:44.265111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02b571-a2f3-4c10-817e-f719b0af6527 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:44.266779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 23/45] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:44.273076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:44.289588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:44.381788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd0af1-813a-4d31-a65b-37fd8a5ede52 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:44.416825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f0edc-df80-449f-8427-32ba63e48f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:44.417450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f0edc-df80-449f-8427-32ba63e48f4d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:44.417730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f0edc-df80-449f-8427-32ba63e48f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:44.418007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f0edc-df80-449f-8427-32ba63e48f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:44.419152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f0edc-df80-449f-8427-32ba63e48f4d None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.domain.id=default, user.id=0c6f9a858cab4edb80d37349ae653b91) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:44.419463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f0edc-df80-449f-8427-32ba63e48f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:44.420905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f0edc-df80-449f-8427-32ba63e48f4d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:44.429307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 23/46] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Oct 11 11:45:44 2022] GET /identity/v3/role_assignments?user.id=0c6f9a858cab4edb80d37349ae653b91&scope.domain.id=default&role.id=d32b6669146241ab9d1fda575c016787 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:46.316008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9498f-ddad-4a2b-8cfd-f09a72684b1e None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:46.316512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9498f-ddad-4a2b-8cfd-f09a72684b1e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:46.316512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9498f-ddad-4a2b-8cfd-f09a72684b1e None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:46.317837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 24/47] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:46.323404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12cb54-6e9a-4d88-b0ed-5b924fb9ae93 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:46.323819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12cb54-6e9a-4d88-b0ed-5b924fb9ae93 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:46.323927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12cb54-6e9a-4d88-b0ed-5b924fb9ae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:46.342817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fd12cb54-6e9a-4d88-b0ed-5b924fb9ae93 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:46.344030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fd12cb54-6e9a-4d88-b0ed-5b924fb9ae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:46.413085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 24/48] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:46.679789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9498f-ddad-4a2b-8cfd-f09a72684b1e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:46.788619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9498f-ddad-4a2b-8cfd-f09a72684b1e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:46.799566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:46.825587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1866a32-d863-48b0-8e12-46330c27e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:46.826233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1866a32-d863-48b0-8e12-46330c27e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:46.826508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1866a32-d863-48b0-8e12-46330c27e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:46.826808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1866a32-d863-48b0-8e12-46330c27e4e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:46.827958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1866a32-d863-48b0-8e12-46330c27e4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:46.829438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1866a32-d863-48b0-8e12-46330c27e4e2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:46.831057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 25/49] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:46.837170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12cb54-6e9a-4d88-b0ed-5b924fb9ae93 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:46.846106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:46.940323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12cb54-6e9a-4d88-b0ed-5b924fb9ae93 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:46.976824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e849580-34c5-4f02-8eea-27b84044a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:46.977667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849580-34c5-4f02-8eea-27b84044a793 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:46.977993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849580-34c5-4f02-8eea-27b84044a793 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:46.978305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849580-34c5-4f02-8eea-27b84044a793 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:46.979057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e849580-34c5-4f02-8eea-27b84044a793 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:46.980624 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e849580-34c5-4f02-8eea-27b84044a793 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:47.010921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 25/50] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Oct 11 11:45:46 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:45:49.160486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21309f07-2141-4cf7-ac79-1e22a43703ae None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:49.161055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21309f07-2141-4cf7-ac79-1e22a43703ae None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:49.161055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21309f07-2141-4cf7-ac79-1e22a43703ae None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:49.162405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 26/51] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:49.168988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd7052-2e13-4cd6-8dd7-8d2d971dacea None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:49.169423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd7052-2e13-4cd6-8dd7-8d2d971dacea None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:49.169535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd7052-2e13-4cd6-8dd7-8d2d971dacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:49.300202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fefd7052-2e13-4cd6-8dd7-8d2d971dacea None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:49.301345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fefd7052-2e13-4cd6-8dd7-8d2d971dacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:49.358727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:49.375337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 26/52] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:49.642170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21309f07-2141-4cf7-ac79-1e22a43703ae None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:49.860946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21309f07-2141-4cf7-ac79-1e22a43703ae None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:49.899330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9fc1f-3b1b-49af-86f3-a53408797b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:49.899895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9fc1f-3b1b-49af-86f3-a53408797b65 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:49.900176 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9fc1f-3b1b-49af-86f3-a53408797b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:49.900445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9fc1f-3b1b-49af-86f3-a53408797b65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:49.901643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9fc1f-3b1b-49af-86f3-a53408797b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:49.903242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9fc1f-3b1b-49af-86f3-a53408797b65 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:49.904887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:49.910967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd7052-2e13-4cd6-8dd7-8d2d971dacea None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:50.021864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd7052-2e13-4cd6-8dd7-8d2d971dacea None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:50.060658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf2575-5313-4795-9bdf-0bdd64a5998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:50.061278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2575-5313-4795-9bdf-0bdd64a5998e None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:50.061558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2575-5313-4795-9bdf-0bdd64a5998e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:50.061802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf2575-5313-4795-9bdf-0bdd64a5998e None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:50.062496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf2575-5313-4795-9bdf-0bdd64a5998e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:50.064058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf2575-5313-4795-9bdf-0bdd64a5998e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:50.097542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 27/54] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:45:49 2022] POST /identity/v3/users => generated 275 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:45:53.898938 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe3441-56c8-4f3a-a61e-12a0b73d21c6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:53.900531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe3441-56c8-4f3a-a61e-12a0b73d21c6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:53.901286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe3441-56c8-4f3a-a61e-12a0b73d21c6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:53.904195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 28/55] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:53.911282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457fbe-bcfe-492a-ae3f-0cd159b7ed2c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:53.912700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457fbe-bcfe-492a-ae3f-0cd159b7ed2c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:53.913443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5457fbe-bcfe-492a-ae3f-0cd159b7ed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:53.949747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e5457fbe-bcfe-492a-ae3f-0cd159b7ed2c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:53.952271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e5457fbe-bcfe-492a-ae3f-0cd159b7ed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:54.056517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:54.119338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 28/56] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:54.548583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe3441-56c8-4f3a-a61e-12a0b73d21c6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:54.670003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:54.768647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54daa7-7e34-4053-9b14-341c294ea95b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:54.769200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54daa7-7e34-4053-9b14-341c294ea95b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:54.769550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54daa7-7e34-4053-9b14-341c294ea95b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:54.772140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 29/57] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:54.778794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282af7-fe48-4b82-a086-075fd6512f87 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:54.779246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282af7-fe48-4b82-a086-075fd6512f87 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:54.779722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282af7-fe48-4b82-a086-075fd6512f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:54.813515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-26282af7-fe48-4b82-a086-075fd6512f87 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:54.814891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-26282af7-fe48-4b82-a086-075fd6512f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:54.820791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe3441-56c8-4f3a-a61e-12a0b73d21c6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:54.863482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adab4f4-be29-424f-b518-d88ab832d99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:54.864139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab4f4-be29-424f-b518-d88ab832d99c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:54.864409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab4f4-be29-424f-b518-d88ab832d99c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:54.864673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adab4f4-be29-424f-b518-d88ab832d99c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:54.877499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adab4f4-be29-424f-b518-d88ab832d99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0adab4f4-be29-424f-b518-d88ab832d99c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:45:54.882627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:54.884505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 29/58] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:45:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:45:54.886227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88da2-02e8-415f-a806-328cd3b4146c None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:54.887765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88da2-02e8-415f-a806-328cd3b4146c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:54.887765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e88da2-02e8-415f-a806-328cd3b4146c None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:54.891936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 30/59] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:54.893021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e88da2-02e8-415f-a806-328cd3b4146c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:54.941330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 30/60] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:45:54.943728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9345-09a1-4190-86a4-6b60eaf9a247 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:54.944558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9345-09a1-4190-86a4-6b60eaf9a247 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:54.945340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b9345-09a1-4190-86a4-6b60eaf9a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:54.987867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1e8b9345-09a1-4190-86a4-6b60eaf9a247 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:54.989986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1e8b9345-09a1-4190-86a4-6b60eaf9a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:55.018402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e88da2-02e8-415f-a806-328cd3b4146c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:55.027875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:55.063257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:55.064229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.064649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.065067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.065919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:55.066413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:55.068048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:55.078708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 31/61] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:45:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:55.089473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:55.212618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:55.215393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e080-05ce-4a1b-a793-761082fe2091 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.216139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e080-05ce-4a1b-a793-761082fe2091 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.216782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904e080-05ce-4a1b-a793-761082fe2091 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.221775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:55.232601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da7231-64ce-44c0-92ee-11917e85a470 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.232886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da7231-64ce-44c0-92ee-11917e85a470 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.233189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da7231-64ce-44c0-92ee-11917e85a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.270127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-40da7231-64ce-44c0-92ee-11917e85a470 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:55.273053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-40da7231-64ce-44c0-92ee-11917e85a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:55.289395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2070a2-585b-4463-a8f1-266f0e5b378c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:55.334084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fc260-9295-49a4-85cf-b492adfd4131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:55.334084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fc260-9295-49a4-85cf-b492adfd4131 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.334474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fc260-9295-49a4-85cf-b492adfd4131 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.334602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fc260-9295-49a4-85cf-b492adfd4131 None admin] PATH_INFO: `/v3/users/d0b7084b60b8461287445edf952b32c1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.345785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:55.365021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fc260-9295-49a4-85cf-b492adfd4131 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b7084b60b8461287445edf952b32c1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:55.366698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fc260-9295-49a4-85cf-b492adfd4131 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:55.368573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 32/64] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:45:55 2022] GET /identity/v3/users/d0b7084b60b8461287445edf952b32c1 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:55.375314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb10e5-8607-4f59-af2b-76b94b593574 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.375314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb10e5-8607-4f59-af2b-76b94b593574 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.375314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb10e5-8607-4f59-af2b-76b94b593574 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.375314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 33/65] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:45:55.378074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453767e-d468-421e-a9f4-aa6c218ac43d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.378397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453767e-d468-421e-a9f4-aa6c218ac43d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.378669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453767e-d468-421e-a9f4-aa6c218ac43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.402269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d453767e-d468-421e-a9f4-aa6c218ac43d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:45:55.403608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d453767e-d468-421e-a9f4-aa6c218ac43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:45:55.431525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:55.445366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:45:55.450592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da7231-64ce-44c0-92ee-11917e85a470 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:55.516671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 34/67] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:45:55.517608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453767e-d468-421e-a9f4-aa6c218ac43d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:55.653294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453767e-d468-421e-a9f4-aa6c218ac43d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:55.679574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da7231-64ce-44c0-92ee-11917e85a470 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:55.698335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:55.699043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.699373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.699743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.713376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:45:55.718766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:55.720828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:45:55.722608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:45:55.725971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:55.748917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:55.768639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:55.770267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.772321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.773144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.775528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:55.779294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:55.783928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:45:55 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:55.786218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:55.842631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:55.848806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2315702-bbb7-4c7c-a1e1-2894fc07c23f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:55.891216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:55.891881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:55.892162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:55.892437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:55.905776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:45:55.910809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:55.912362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:45:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:45:55.913953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:55.964585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43796151-2208-465e-83eb-832ee0c85c07 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.013147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.013941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.014302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.014697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.015471 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:56.015867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:56.016500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:56.017767 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:56.037268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:56.038689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.055418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e5e82-6129-429a-bb5f-30c04456e5f5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.100108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.101164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.101539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.101934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/d0b7084b60b8461287445edf952b32c1/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.105293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] RBAC: Authorizing `identity:create_grant(project_id=9db0c2d2975949bdb6306acd527d555a, user_id=d0b7084b60b8461287445edf952b32c1, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:56.108317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:56.128632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 37/72] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:45:55 2022] PUT /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/d0b7084b60b8461287445edf952b32c1/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:45:56.129509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.186286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:56.196294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac5682-179b-4a7c-8326-88aee21726d2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.244164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.245347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.245869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.246383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.249129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:56.252235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:56.255489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:56.263731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.288655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57becae-f052-49ed-bd4f-059bede50b5f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.346269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.347255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.347705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.348086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.349211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:56.349640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:56.352138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:56.362809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:56.377372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:45:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:56.379022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.431079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329263f3-41b2-4c5a-87b0-21a9480ea162 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.476451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.477402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.477849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.478283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.496954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:45:56.509218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:45:56.510087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:45:56.510857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:45:56.515656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:45:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:45:56.515656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.537707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7caca-5e39-43a1-a04d-519010fdbb9a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.556023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:56.588761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.589535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.589944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.590426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] PATH_INFO: `/v3/users/0c6f9a858cab4edb80d37349ae653b91` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.591878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] RBAC: Authorizing `identity:get_user(user_id=0c6f9a858cab4edb80d37349ae653b91)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:56.593893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:56.596303 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 39/76] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:45:56 2022] GET /identity/v3/users/0c6f9a858cab4edb80d37349ae653b91 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:56.597653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.659753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871e0fe-9b3d-4679-b829-9b5eb6d6c049 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.688118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:56.700646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.701268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.701533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.701800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.702464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:56.703964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:56.736402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 38/77] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:45:56 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:45:56.738358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.740358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cf14e-ebc3-4b86-b59e-8a1521e398e6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:56.810841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:56.812224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:56.812879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:56.813488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] PATH_INFO: `/v3/users/d0b7084b60b8461287445edf952b32c1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:56.817204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b7084b60b8461287445edf952b32c1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:56.820103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:56.823826 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 40/78] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:45:56 2022] GET /identity/v3/users/d0b7084b60b8461287445edf952b32c1 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:56.826217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:56.910995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:56.948526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6ff5-b42a-4876-a01f-f288df21bacc None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:57.025560 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:57.026151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:57.026394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:57.026671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:57.028021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:45:57.028021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:57.029146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:57.040344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 39/79] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:45:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:57.040940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:57.044969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b28c7-a462-41a4-8909-c25faf5fb258 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:57.090416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:57.091124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:57.091402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:57.091767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:57.092910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:57.094382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:57.098525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:45:56 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:57.098525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:57.100093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:57.198543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef46e8f-b483-46a7-bffa-320b39ec2a6b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:57.243428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:57.244669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:57.244953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:57.245223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] PATH_INFO: `/v3/projects/e08064462fee4e3d9f3a67a043981caa` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:57.248508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] RBAC: Authorizing `identity:get_project(project_id=e08064462fee4e3d9f3a67a043981caa)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:57.249321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ccfa5-75ab-487c-ae42-0d7cd6f68905 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:57.250027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:57.252170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:45:57 2022] GET /identity/v3/projects/e08064462fee4e3d9f3a67a043981caa => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:57.254039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:57.279198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:57.304872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:57.305532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:57.305801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:57.306064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] PATH_INFO: `/v3/users/d0b7084b60b8461287445edf952b32c1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:57.308048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] RBAC: Authorizing `identity:get_user(user_id=d0b7084b60b8461287445edf952b32c1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:57.309707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:57.311780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:45:57 2022] GET /identity/v3/users/d0b7084b60b8461287445edf952b32c1 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:57.312229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:57.400259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:57.467866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14578d1-3c3a-483f-8e5d-3deeb7085b3f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:57.475041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4b21c-e263-4a19-a187-b848d79d59ac None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:57.579472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:57.580591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:57.581056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:57.581333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:57.581813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] PATH_INFO: `/v3/projects/e08064462fee4e3d9f3a67a043981caa/users/d0b7084b60b8461287445edf952b32c1/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:57.582493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:57.583036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:57.583532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/0c6f9a858cab4edb80d37349ae653b91/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:57.587532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] RBAC: Authorizing `identity:create_grant(project_id=e08064462fee4e3d9f3a67a043981caa, user_id=d0b7084b60b8461287445edf952b32c1, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:57.587707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] RBAC: Authorizing `identity:create_grant(project_id=9db0c2d2975949bdb6306acd527d555a, user_id=0c6f9a858cab4edb80d37349ae653b91, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:57.589540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:57.590478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:57.619524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 41/83] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:45:57 2022] PUT /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/0c6f9a858cab4edb80d37349ae653b91/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:45:57.621309 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:57.623724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 43/84] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:45:57 2022] PUT /identity/v3/projects/e08064462fee4e3d9f3a67a043981caa/users/d0b7084b60b8461287445edf952b32c1/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:45:57.751414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:57.809673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ed41d-f16f-45ee-8830-da45fc0d5b5d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:57.899867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3526a-9d1e-47ad-8eea-1762d73d062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:57.900881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3526a-9d1e-47ad-8eea-1762d73d062b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:57.901355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3526a-9d1e-47ad-8eea-1762d73d062b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:57.901837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3526a-9d1e-47ad-8eea-1762d73d062b None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:57.904081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3526a-9d1e-47ad-8eea-1762d73d062b None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:57.909909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3526a-9d1e-47ad-8eea-1762d73d062b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:57.913531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:45:57 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:45:57.923072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:45:58.068285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904c49c-e71e-466f-901f-8b817f636451 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:45:58.109332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:45:58.117287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5090a-f493-4e75-98cb-4d448c99d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:45:58.117992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5090a-f493-4e75-98cb-4d448c99d1b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:45:58.118281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5090a-f493-4e75-98cb-4d448c99d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:45:58.118898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5090a-f493-4e75-98cb-4d448c99d1b2 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/d0b7084b60b8461287445edf952b32c1/roles/ba129f3d0c7c49f08f7334bbc914a775` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:45:58.121766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5090a-f493-4e75-98cb-4d448c99d1b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9db0c2d2975949bdb6306acd527d555a, user_id=d0b7084b60b8461287445edf952b32c1, role_id=ba129f3d0c7c49f08f7334bbc914a775)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:45:58.123299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5090a-f493-4e75-98cb-4d448c99d1b2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:45:58.144976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 44/86] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:45:57 2022] PUT /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/d0b7084b60b8461287445edf952b32c1/roles/ba129f3d0c7c49f08f7334bbc914a775 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:46:00.217399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5214-a010-4b45-abb0-cad7a17dbc54 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:00.217926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5214-a010-4b45-abb0-cad7a17dbc54 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:00.218354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5214-a010-4b45-abb0-cad7a17dbc54 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:00.221043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 43/87] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:00.228447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ea3c7-d882-4b2c-87a3-8df01caa04e1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:00.228933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ea3c7-d882-4b2c-87a3-8df01caa04e1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:00.229325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ea3c7-d882-4b2c-87a3-8df01caa04e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:00.263918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0f2ea3c7-d882-4b2c-87a3-8df01caa04e1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:00.266474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0f2ea3c7-d882-4b2c-87a3-8df01caa04e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:00.375787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0af2-c130-47af-9878-975e08b21b9b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:00.376560 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0af2-c130-47af-9878-975e08b21b9b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:00.377187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0af2-c130-47af-9878-975e08b21b9b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:00.379398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 44/88] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:00.386396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29c68-c8d5-456c-ad46-b0051d9e524c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:00.387173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29c68-c8d5-456c-ad46-b0051d9e524c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:00.387651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c29c68-c8d5-456c-ad46-b0051d9e524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:00.430532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f6c29c68-c8d5-456c-ad46-b0051d9e524c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:00.434915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f6c29c68-c8d5-456c-ad46-b0051d9e524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:00.465765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:00.587524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 45/90] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:00.764376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49707a-6339-45f7-8071-59ecc948869c None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:00.765056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49707a-6339-45f7-8071-59ecc948869c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:00.765546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49707a-6339-45f7-8071-59ecc948869c None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:00.767159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 46/91] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:00.773067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae725-2adb-40b6-93f3-65ad9f9a925d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:00.773658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae725-2adb-40b6-93f3-65ad9f9a925d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:00.774118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ae725-2adb-40b6-93f3-65ad9f9a925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:00.801168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d43ae725-2adb-40b6-93f3-65ad9f9a925d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:00.802728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d43ae725-2adb-40b6-93f3-65ad9f9a925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:00.842752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49707a-6339-45f7-8071-59ecc948869c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:00.913712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:00.930756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 46/92] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:01.012296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49707a-6339-45f7-8071-59ecc948869c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:01.041377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:01.063911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:01.064579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.064856 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.065121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.081965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:01.087170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:01.088083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:01.089387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:01.096571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae725-2adb-40b6-93f3-65ad9f9a925d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:01.156969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:01.283007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ae725-2adb-40b6-93f3-65ad9f9a925d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:01.376371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9af7ae-fd3c-49a9-a800-b98dde54e69c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:01.387191 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad9f5-07b7-4392-b1e2-627f8d472a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:01.387832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad9f5-07b7-4392-b1e2-627f8d472a3f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.388109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad9f5-07b7-4392-b1e2-627f8d472a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.388444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad9f5-07b7-4392-b1e2-627f8d472a3f None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.389142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ad9f5-07b7-4392-b1e2-627f8d472a3f None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:01.389487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ad9f5-07b7-4392-b1e2-627f8d472a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:01.390939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ad9f5-07b7-4392-b1e2-627f8d472a3f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:01.404332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 47/94] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:01.407160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1a02-8089-49ab-b30f-69e1f18e4363 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.408791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1a02-8089-49ab-b30f-69e1f18e4363 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.409277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1a02-8089-49ab-b30f-69e1f18e4363 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.411769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 48/95] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:01.413833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1a02-8089-49ab-b30f-69e1f18e4363 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:01.432701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:01.433356 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.433635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.433946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.446078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:01.451123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:01.452845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:01.454407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:01.515754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:01.525127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:01.575396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1a02-8089-49ab-b30f-69e1f18e4363 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:01.616737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24827fa-2759-468e-a5c9-5e7d22ef753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:01.617653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24827fa-2759-468e-a5c9-5e7d22ef753a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.618035 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24827fa-2759-468e-a5c9-5e7d22ef753a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.618459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24827fa-2759-468e-a5c9-5e7d22ef753a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.619962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24827fa-2759-468e-a5c9-5e7d22ef753a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:01.621944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24827fa-2759-468e-a5c9-5e7d22ef753a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:01.630680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:01.630680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758152e-26f5-4459-b0a0-3ad371311521 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.630680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758152e-26f5-4459-b0a0-3ad371311521 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.630680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758152e-26f5-4459-b0a0-3ad371311521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.642819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696655ad-1a87-4b82-b2c2-2f3eb4358a95 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:01.649533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4758152e-26f5-4459-b0a0-3ad371311521 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:01.650958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4758152e-26f5-4459-b0a0-3ad371311521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:01.702031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:01.705479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.706290 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.707023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] PATH_INFO: `/v3/users/d0b7084b60b8461287445edf952b32c1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.708790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] RBAC: Authorizing `identity:get_user(user_id=d0b7084b60b8461287445edf952b32c1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:01.711289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:01.713244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 49/98] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:01 2022] GET /identity/v3/users/d0b7084b60b8461287445edf952b32c1 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:01.714853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:01.751493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:01.752653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758152e-26f5-4459-b0a0-3ad371311521 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:01.828002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:01.858877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71b37a-efce-4dd4-bd77-0df7f08040cc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:01.878502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:01.885298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758152e-26f5-4459-b0a0-3ad371311521 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:01.925837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7560-66ee-4a02-a2c4-3d722156f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:01.926460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7560-66ee-4a02-a2c4-3d722156f4bd None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.926774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7560-66ee-4a02-a2c4-3d722156f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.927046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7560-66ee-4a02-a2c4-3d722156f4bd None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.927292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:01.927715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d7560-66ee-4a02-a2c4-3d722156f4bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:01.928328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.928835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.929188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d7560-66ee-4a02-a2c4-3d722156f4bd None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:01.929453 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.930671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:01.931222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:01.933676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:01.949318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 50/100] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:01.950883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:01.962878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 51/101] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:46:01 2022] POST /identity/v3/projects => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:46:01.972853 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ebb0-f2d4-451e-bf33-461b93c1bb91 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.973349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ebb0-f2d4-451e-bf33-461b93c1bb91 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.973775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ebb0-f2d4-451e-bf33-461b93c1bb91 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.975634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 52/102] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:01.977222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20818fc5-958e-4b8c-81b5-fee014d21e48 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:01.977658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20818fc5-958e-4b8c-81b5-fee014d21e48 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:01.978160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20818fc5-958e-4b8c-81b5-fee014d21e48 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:01.980138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 53/103] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:01.981354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20818fc5-958e-4b8c-81b5-fee014d21e48 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:02.124958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ee6a8-5e4f-4629-a6c3-8a1674133477 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:02.137592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20818fc5-958e-4b8c-81b5-fee014d21e48 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:02.151242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:02.189339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:02.190044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.190334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.190597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:02.191589 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afadc55-7dce-4967-9d9a-aecff0e624c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:02.192260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afadc55-7dce-4967-9d9a-aecff0e624c4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.192554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afadc55-7dce-4967-9d9a-aecff0e624c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.192911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afadc55-7dce-4967-9d9a-aecff0e624c4 None admin] PATH_INFO: `/v3/users/2fcd02d7104c408e8665b7e89f51be76` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:02.215348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afadc55-7dce-4967-9d9a-aecff0e624c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2fcd02d7104c408e8665b7e89f51be76)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:02.216854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afadc55-7dce-4967-9d9a-aecff0e624c4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:02.218601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 54/104] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:01 2022] GET /identity/v3/users/2fcd02d7104c408e8665b7e89f51be76 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:02.219879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d3c20-6134-482c-a76e-319a35d67ece None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.220165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d3c20-6134-482c-a76e-319a35d67ece None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.220432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d3c20-6134-482c-a76e-319a35d67ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:02.239715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b12d3c20-6134-482c-a76e-319a35d67ece None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:02.240902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b12d3c20-6134-482c-a76e-319a35d67ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:02.249637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:02.284767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:02.286296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:02.322153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 55/105] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:02.331672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86967ce-2e20-48a8-be79-dc064d2fed90 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.332424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86967ce-2e20-48a8-be79-dc064d2fed90 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.333061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86967ce-2e20-48a8-be79-dc064d2fed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:02.368575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c86967ce-2e20-48a8-be79-dc064d2fed90 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:02.371044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c86967ce-2e20-48a8-be79-dc064d2fed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:02.436188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 51/106] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:02.441864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:02.478661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 56/107] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:02.479931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86967ce-2e20-48a8-be79-dc064d2fed90 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:02.512444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:02.561338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:02.606447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475bd3a-5f0c-4c50-a76f-710e778e15a1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:02.635432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86967ce-2e20-48a8-be79-dc064d2fed90 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:02.676417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:02.677503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.677980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.678706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:02.679905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:02.680713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.681131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.681609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:02.683240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:02.685031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:02.687206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 57/108] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:02 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:02.688167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:02.698924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:02.709185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:02.710358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:02.711297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 52/109] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:02.712597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:02.809828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:02.818738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1f054-a354-4dbb-ba02-d5b0d0392fa2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:02.865048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:02.866084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.867172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.867672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:02.869877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:02.872810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:02.880964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 58/110] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:02 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:02.880964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:02.909871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c6ce-f177-4d13-a8d1-823dd57064ea None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:02.962599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:02.979302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:02.980962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:02.981487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:02.982860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:03.010378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:03.017782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:03.019206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:03.020699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:03.023084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 53/111] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:03.025095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:03.065677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4638b-9178-44e3-9dbf-e85468bea769 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:03.119795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:03.120520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:03.120798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:03.121066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/2fcd02d7104c408e8665b7e89f51be76/roles/a0aaeb427bd246cb822d06423bbc4e53` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:03.123521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] RBAC: Authorizing `identity:create_grant(project_id=9db0c2d2975949bdb6306acd527d555a, user_id=2fcd02d7104c408e8665b7e89f51be76, role_id=a0aaeb427bd246cb822d06423bbc4e53)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:03.125043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:03.142246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 59/112] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:02 2022] PUT /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a/users/2fcd02d7104c408e8665b7e89f51be76/roles/a0aaeb427bd246cb822d06423bbc4e53 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:03.143554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:03.198288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:03.240844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d0fa4-375b-4bbc-b882-9b7402889f91 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:03.313750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:03.315781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:03.316717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:03.317538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:03.319467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:03.320394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:03.323670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:03.340743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 54/113] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:03.342802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:03.374412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c08487-e1cd-4f33-87fd-b4e4a7765ace None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:03.448057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:03.449520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:03.449920 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:03.450334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:03.458516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:03.471221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:03.479730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:03.481473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:03.483085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 60/114] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:46:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:03.484280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:03.568367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d04c41-1d92-408f-9e52-25719e4b53ae None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:03.617534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:03.618370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:03.618705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:03.618979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:03.619910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] RBAC: Adding query filter params (role.id=4b08dbe46a7c4b618462666ee2e4b395, scope.project.id=9db0c2d2975949bdb6306acd527d555a, user.id=d0b7084b60b8461287445edf952b32c1) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:03.620606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:03.623523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:03.640026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 55/115] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:03 2022] GET /identity/v3/role_assignments?user.id=d0b7084b60b8461287445edf952b32c1&scope.project.id=9db0c2d2975949bdb6306acd527d555a&role.id=4b08dbe46a7c4b618462666ee2e4b395 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:03.640267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:03.642039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:03.670673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4aae-cdfd-4074-8bca-51d7aefe7a95 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:03.711440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:03.712076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:03.712358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:03.712633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:03.713518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:03.713826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:03.715337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:03.725216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 61/116] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:03.725854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:03.868749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48106f2-6efa-45f7-a4e5-d69eecfc5f0e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:03.908067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:03.908725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:03.909008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:03.909287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:03.910026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:03.910653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:03.913192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:03.925307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 62/117] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:03.926331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:03.943213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:03.983055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6ea75-4896-48b9-b81e-4ce0e448d7af None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.042446 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:04.100223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.100882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.101159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.101425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] PATH_INFO: `/v3/users/d0b7084b60b8461287445edf952b32c1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.103375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b7084b60b8461287445edf952b32c1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.105253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.107853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 56/118] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:03 2022] GET /identity/v3/users/d0b7084b60b8461287445edf952b32c1 => generated 275 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:04.109041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:04.131504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f076d9-f93d-4793-98cd-6714afec8a4e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.185845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.187178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.187810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.188677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] PATH_INFO: `/v3/users/0c6f9a858cab4edb80d37349ae653b91` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.191222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] RBAC: Authorizing `identity:get_user(user_id=0c6f9a858cab4edb80d37349ae653b91)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.193252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.197746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 63/119] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:03 2022] GET /identity/v3/users/0c6f9a858cab4edb80d37349ae653b91 => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:04.199732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:04.261533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5684e-338e-4dbd-b17a-1c5c0aea1dd1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.311438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.312566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.313058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.313536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] PATH_INFO: `/v3/users/d0b7084b60b8461287445edf952b32c1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.314792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:04.315645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b7084b60b8461287445edf952b32c1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.317282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.319324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 57/120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:04 2022] GET /identity/v3/users/d0b7084b60b8461287445edf952b32c1 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:04.320214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:04.349282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876e59d-6a1b-42bf-b183-6e5105c26c58 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.383802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:04.386648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.387331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.387604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.387873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.436729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befe57b-48a8-4c59-b228-109f9a585565 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.465299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.466930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.474799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b3db3-a26b-40c3-a525-a6ea2b7194b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.476071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3db3-a26b-40c3-a525-a6ea2b7194b4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.476492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3db3-a26b-40c3-a525-a6ea2b7194b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.476907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3db3-a26b-40c3-a525-a6ea2b7194b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.548684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b3db3-a26b-40c3-a525-a6ea2b7194b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.550441 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b3db3-a26b-40c3-a525-a6ea2b7194b4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.550970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:04.579194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 64/121] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:04.580515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:04.612654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:04.669731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 58/122] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:04.669731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a7fd-785c-471c-adb8-f4f6afdad483 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.669731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a7fd-785c-471c-adb8-f4f6afdad483 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.669731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a7fd-785c-471c-adb8-f4f6afdad483 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.669731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 59/123] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:04.669731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933a7fd-785c-471c-adb8-f4f6afdad483 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:04.694005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b471052-031c-4d29-96fd-43b27a812328 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.730208 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b083b-665d-4530-8524-87e14f5e5220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.730891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b083b-665d-4530-8524-87e14f5e5220 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.731172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b083b-665d-4530-8524-87e14f5e5220 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.731443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b083b-665d-4530-8524-87e14f5e5220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.777992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:04.788275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933a7fd-785c-471c-adb8-f4f6afdad483 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.807083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b083b-665d-4530-8524-87e14f5e5220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.808618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b083b-665d-4530-8524-87e14f5e5220 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.826724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.827822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.828358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.828867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] PATH_INFO: `/v3/projects/e08064462fee4e3d9f3a67a043981caa` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.830294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] RBAC: Authorizing `identity:get_project(project_id=e08064462fee4e3d9f3a67a043981caa)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.832125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.834126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 60/124] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:04 2022] GET /identity/v3/projects/e08064462fee4e3d9f3a67a043981caa => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:04.835200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:04.861596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:04.937640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 65/125] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:04.939144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bf677-9f74-43a9-8140-b24c73eb07f2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.939446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bf677-9f74-43a9-8140-b24c73eb07f2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.939715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bf677-9f74-43a9-8140-b24c73eb07f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.952339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335052c-fb74-417c-8f80-efb489d2577f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:04.968664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4b4bf677-9f74-43a9-8140-b24c73eb07f2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:04.970741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4b4bf677-9f74-43a9-8140-b24c73eb07f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:04.989870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:04.990894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:04.991860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:04.992348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:04.993775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:04.996376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:04.999129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 61/126] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:04 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:05.000168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:05.079049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 66/127] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:05.079049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bf677-9f74-43a9-8140-b24c73eb07f2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:05.079049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:05.129292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:05.143564 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98f04-dbdd-485b-8f2a-32e18875abda None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:05.194192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:05.195137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.195463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.196185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.197271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] RBAC: Adding query filter params (role.id=4b08dbe46a7c4b618462666ee2e4b395, scope.project.id=e08064462fee4e3d9f3a67a043981caa, user.id=d0b7084b60b8461287445edf952b32c1) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:05.197584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:05.198705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bf677-9f74-43a9-8140-b24c73eb07f2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:05.199111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:05.207708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 62/128] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:04 2022] GET /identity/v3/role_assignments?user.id=d0b7084b60b8461287445edf952b32c1&scope.project.id=e08064462fee4e3d9f3a67a043981caa&role.id=4b08dbe46a7c4b618462666ee2e4b395 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:05.208622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:05.285323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:05.285985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.286266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.286540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.289301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:05.291870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:05.294280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 67/129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:05 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:05.303942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:05.370965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09616f24-e8de-4d67-b737-e22131de8eb3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:05.427406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:05.428587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.429748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.430051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.431940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=9db0c2d2975949bdb6306acd527d555a, user.id=0c6f9a858cab4edb80d37349ae653b91) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:05.432493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:05.436707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:05.442405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:05.456772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 63/130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:05 2022] GET /identity/v3/role_assignments?user.id=0c6f9a858cab4edb80d37349ae653b91&scope.project.id=9db0c2d2975949bdb6306acd527d555a&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:05.459096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:05.493176 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:05.495852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e53d2-6084-496a-939d-298fb00e9b3a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:05.545328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:05.546024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.546311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.546612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.547380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] RBAC: Adding query filter params (role.id=ba129f3d0c7c49f08f7334bbc914a775, scope.project.id=9db0c2d2975949bdb6306acd527d555a, user.id=d0b7084b60b8461287445edf952b32c1) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:05.547712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:05.549231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:05.557817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 68/131] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:05 2022] GET /identity/v3/role_assignments?user.id=d0b7084b60b8461287445edf952b32c1&scope.project.id=9db0c2d2975949bdb6306acd527d555a&role.id=ba129f3d0c7c49f08f7334bbc914a775 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:05.633042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259885-4256-4e09-bff2-8899f42ade64 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:05.678930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16df5d-7ba7-42ae-91ff-dc40221d3a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:05.679958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16df5d-7ba7-42ae-91ff-dc40221d3a68 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.680432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16df5d-7ba7-42ae-91ff-dc40221d3a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.680893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16df5d-7ba7-42ae-91ff-dc40221d3a68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.682724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16df5d-7ba7-42ae-91ff-dc40221d3a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:05.684702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16df5d-7ba7-42ae-91ff-dc40221d3a68 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:05.687334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 64/132] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:05.694125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:05.851970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd4c9-b683-42ac-9f73-3867b1c9d2bc None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:05.892163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:05.892784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.893059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.893324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.893989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:05.895467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:05.904888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:05.916791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601420f4-1f64-4be6-baee-7b6e8553af63 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.917069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601420f4-1f64-4be6-baee-7b6e8553af63 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.917335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601420f4-1f64-4be6-baee-7b6e8553af63 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.919157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 65/133] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:05.926665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 69/134] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:05 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:46:05.928437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ecc9-42a5-4874-b3fd-2dc865a90245 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:05.928942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ecc9-42a5-4874-b3fd-2dc865a90245 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:05.929428 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ecc9-42a5-4874-b3fd-2dc865a90245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:05.955312 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-77e0ecc9-42a5-4874-b3fd-2dc865a90245 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:05.956584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-77e0ecc9-42a5-4874-b3fd-2dc865a90245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:06.059112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 66/135] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:06.325249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:06.465017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767819d-bff1-4926-81ac-05f77f462c70 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:06.518172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:06.519097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:06.519469 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:06.519740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:06.535546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:06.541764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:06.543416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:06.544752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 70/136] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:06.551045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ecc9-42a5-4874-b3fd-2dc865a90245 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:06.570954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:06.666400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ecc9-42a5-4874-b3fd-2dc865a90245 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:06.723585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:06.724755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:06.725269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:06.725765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:06.727212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:06.727754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:06.730791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:06.748128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 67/137] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:06.754734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:06.826361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:06.883632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829554-1981-4813-8fff-2cde1701d623 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:06.927015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:06.928186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:06.928704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:06.929245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] PATH_INFO: `/v3/users/2fcd02d7104c408e8665b7e89f51be76` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:06.931121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] RBAC: Authorizing `identity:get_user(user_id=2fcd02d7104c408e8665b7e89f51be76)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:06.933047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:06.935191 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 71/138] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:06 2022] GET /identity/v3/users/2fcd02d7104c408e8665b7e89f51be76 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:06.941548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:07.096592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:07.138048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc0990-844b-4b3d-8c01-079a1c2c966d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:07.204403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:07.205321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:07.205789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:07.206267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:07.325926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:07.328680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:07.458441 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:07.486463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 68/139] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 11:46:07.492533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:07.607785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4014a-03f8-42bb-9a2e-7ac86b5812b1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:07.628928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:07.643892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c169f00-d507-4733-8542-54a401deaa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:07.644540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c169f00-d507-4733-8542-54a401deaa23 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:07.644821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c169f00-d507-4733-8542-54a401deaa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:07.645096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c169f00-d507-4733-8542-54a401deaa23 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:07.646264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c169f00-d507-4733-8542-54a401deaa23 None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:07.647772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c169f00-d507-4733-8542-54a401deaa23 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:07.649448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 72/140] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:07 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:07.655523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:07.775007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c97ba-b691-476e-90fe-acd3fbc3c001 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:07.812936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b53e3-5f76-42d2-b741-8f3a64d76988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:07.814025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b53e3-5f76-42d2-b741-8f3a64d76988 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:07.814507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b53e3-5f76-42d2-b741-8f3a64d76988 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:07.814998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b53e3-5f76-42d2-b741-8f3a64d76988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:07.816064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b53e3-5f76-42d2-b741-8f3a64d76988 None admin] RBAC: Adding query filter params (role.id=a0aaeb427bd246cb822d06423bbc4e53, scope.project.id=9db0c2d2975949bdb6306acd527d555a, user.id=2fcd02d7104c408e8665b7e89f51be76) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:07.816616 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b53e3-5f76-42d2-b741-8f3a64d76988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:07.818426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b53e3-5f76-42d2-b741-8f3a64d76988 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:07.825826 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 69/141] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:07 2022] GET /identity/v3/role_assignments?user.id=2fcd02d7104c408e8665b7e89f51be76&scope.project.id=9db0c2d2975949bdb6306acd527d555a&role.id=a0aaeb427bd246cb822d06423bbc4e53 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:08.293504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b72c6-9a23-4fe5-a799-71daac97af51 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:08.293922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b72c6-9a23-4fe5-a799-71daac97af51 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:08.294020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b72c6-9a23-4fe5-a799-71daac97af51 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:08.295423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 73/142] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:08.301097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62978-c73a-41d9-b024-31fd6ed6e1f8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:08.301393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62978-c73a-41d9-b024-31fd6ed6e1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:08.301647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b62978-c73a-41d9-b024-31fd6ed6e1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:08.321253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-01b62978-c73a-41d9-b024-31fd6ed6e1f8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:08.322509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-01b62978-c73a-41d9-b024-31fd6ed6e1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:08.362735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:08.397915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 70/143] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:08.604066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d105dd-da38-4694-98d8-c85d4eb8fb7d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:08.604567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d105dd-da38-4694-98d8-c85d4eb8fb7d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:08.604567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d105dd-da38-4694-98d8-c85d4eb8fb7d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:08.606010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 74/144] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:08.611904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089197b1-1f03-43f9-a902-b111c3bfc363 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:08.612187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089197b1-1f03-43f9-a902-b111c3bfc363 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:08.612468 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089197b1-1f03-43f9-a902-b111c3bfc363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:08.631945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-089197b1-1f03-43f9-a902-b111c3bfc363 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:08.633201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-089197b1-1f03-43f9-a902-b111c3bfc363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:08.664160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d105dd-da38-4694-98d8-c85d4eb8fb7d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:08.709111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 71/145] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:08.788721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d105dd-da38-4694-98d8-c85d4eb8fb7d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:08.833126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:08.833823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:08.834111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:08.834377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:08.849167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:08.857535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:08.858396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:08.859479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:08.860271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 75/146] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:46:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:08.866635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089197b1-1f03-43f9-a902-b111c3bfc363 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:08.982453 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:08.993813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:09.000370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089197b1-1f03-43f9-a902-b111c3bfc363 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:09.043469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:09.044113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.044388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.044691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.045818 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:09.046158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:09.047923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:09.048972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:09.062721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 72/147] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:09.064768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:09.121091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c57fe2-d87a-42c8-b8c6-3a52259dfd40 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:09.167363 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:09.168341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.168953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.169229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.170395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:09.172377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:09.174532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 76/148] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:09.179864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:09.187197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade32ff-024e-4fad-8631-fbb7de05a0ab None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:09.226721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:09.227371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.227645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.227908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] PATH_INFO: `/v3/users/d784d6c396f2465db5176c3a5c5d7af1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.243699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] RBAC: Authorizing `identity:get_user(user_id=d784d6c396f2465db5176c3a5c5d7af1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:09.245186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:09.247062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 73/149] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:09 2022] GET /identity/v3/users/d784d6c396f2465db5176c3a5c5d7af1 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:09.253506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:09.276851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:09.313733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e0f8-bca4-4396-8ac1-09766554291e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:09.337239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:09.359683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8520fa-1d1d-4024-a011-9d38e4f32411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:09.360312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8520fa-1d1d-4024-a011-9d38e4f32411 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.360586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8520fa-1d1d-4024-a011-9d38e4f32411 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.360865 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8520fa-1d1d-4024-a011-9d38e4f32411 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.361531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8520fa-1d1d-4024-a011-9d38e4f32411 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:09.363033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8520fa-1d1d-4024-a011-9d38e4f32411 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:09.367963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8960e4-6812-4abe-a049-96506a332b9e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:09.398148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 77/150] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:09 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:46:09.398148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5729b-ea77-4106-915f-e9d985218653 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.398148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5729b-ea77-4106-915f-e9d985218653 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.398148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5729b-ea77-4106-915f-e9d985218653 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.398148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 78/151] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:09.401075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18e2e-7231-4eb6-ad67-d0d33c1e6e5f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.401426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18e2e-7231-4eb6-ad67-d0d33c1e6e5f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.402856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18e2e-7231-4eb6-ad67-d0d33c1e6e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.428509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:09.429399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.429680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.429936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.431240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:09.432808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:09.434417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c9b18e2e-7231-4eb6-ad67-d0d33c1e6e5f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:09.436587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c9b18e2e-7231-4eb6-ad67-d0d33c1e6e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:09.439825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 74/152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:09 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:09.440603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:09.563796 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 79/153] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:09.596667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:09.614005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165376d-40c7-44ea-a6e4-f19c13ac81dc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:09.663534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58b826-5a79-471e-925e-095248331abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:09.664584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58b826-5a79-471e-925e-095248331abc None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:09.665013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58b826-5a79-471e-925e-095248331abc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:09.665385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58b826-5a79-471e-925e-095248331abc None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/d784d6c396f2465db5176c3a5c5d7af1/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:09.668315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58b826-5a79-471e-925e-095248331abc None admin] RBAC: Authorizing `identity:create_grant(project_id=eb55422b2fa54e5baef36f84f4fa45fb, user_id=d784d6c396f2465db5176c3a5c5d7af1, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:09.670264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58b826-5a79-471e-925e-095248331abc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:09.693815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 75/154] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:09 2022] PUT /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/d784d6c396f2465db5176c3a5c5d7af1/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:46:09.840447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b18e2e-7231-4eb6-ad67-d0d33c1e6e5f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:10.013683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b18e2e-7231-4eb6-ad67-d0d33c1e6e5f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:10.015543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:10.056755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:10.057533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:10.057820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:10.058099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:10.073651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:10.080375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:10.081305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:10.082903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 80/155] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:46:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:10.088593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58b826-5a79-471e-925e-095248331abc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:10.265193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58b826-5a79-471e-925e-095248331abc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:10.328503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:10.329364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:10.329871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:10.330341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:10.331600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:10.332082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:10.334739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:10.350916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 76/156] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:10.360043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:10.513716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdc549-a645-413d-b237-7f7b0e1a5432 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:10.556097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:10.556725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:10.557000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:10.557271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] PATH_INFO: `/v3/users/d784d6c396f2465db5176c3a5c5d7af1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:10.558678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] RBAC: Authorizing `identity:get_user(user_id=d784d6c396f2465db5176c3a5c5d7af1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:10.560148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:10.562186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 81/157] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:10 2022] GET /identity/v3/users/d784d6c396f2465db5176c3a5c5d7af1 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:10.571260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:10.595971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:10.695685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02579f4d-cfa4-414c-a2eb-ea1c82226c7e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:10.751841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b8806-e1a7-44d9-b7da-0c9ff40cb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:10.752721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b8806-e1a7-44d9-b7da-0c9ff40cb118 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:10.753203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b8806-e1a7-44d9-b7da-0c9ff40cb118 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:10.753655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b8806-e1a7-44d9-b7da-0c9ff40cb118 None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:10.755656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b8806-e1a7-44d9-b7da-0c9ff40cb118 None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:10.758411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b8806-e1a7-44d9-b7da-0c9ff40cb118 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:10.761927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 77/158] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:10 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:10.771057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:10.830635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:10.912822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3156dc-0e62-45e6-897b-cad5bc94636c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:10.952136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee20f89-da1a-4289-83ae-8978100747ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:10.952816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20f89-da1a-4289-83ae-8978100747ee None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:10.953090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20f89-da1a-4289-83ae-8978100747ee None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:10.953354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20f89-da1a-4289-83ae-8978100747ee None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/d784d6c396f2465db5176c3a5c5d7af1/roles/ba129f3d0c7c49f08f7334bbc914a775` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:10.955675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee20f89-da1a-4289-83ae-8978100747ee None admin] RBAC: Authorizing `identity:create_grant(project_id=eb55422b2fa54e5baef36f84f4fa45fb, user_id=d784d6c396f2465db5176c3a5c5d7af1, role_id=ba129f3d0c7c49f08f7334bbc914a775)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:10.957219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee20f89-da1a-4289-83ae-8978100747ee None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:10.976564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 82/159] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:10 2022] PUT /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/d784d6c396f2465db5176c3a5c5d7af1/roles/ba129f3d0c7c49f08f7334bbc914a775 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:12.016934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0587cb-24ec-4f20-87f4-73f0c6a1d0d9 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:12.018364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0587cb-24ec-4f20-87f4-73f0c6a1d0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:12.019167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0587cb-24ec-4f20-87f4-73f0c6a1d0d9 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:12.021887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 78/160] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:12.031313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2f273-4b32-4511-9aba-2e86b549b89b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:12.032671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2f273-4b32-4511-9aba-2e86b549b89b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:12.033401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2f273-4b32-4511-9aba-2e86b549b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:12.065688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fbd2f273-4b32-4511-9aba-2e86b549b89b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:12.068380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fbd2f273-4b32-4511-9aba-2e86b549b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:12.187914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 83/161] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:12.346418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823e79-bc66-44a6-b32b-cc8f309c4cfb None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:12.346668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823e79-bc66-44a6-b32b-cc8f309c4cfb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:12.347049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823e79-bc66-44a6-b32b-cc8f309c4cfb None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:12.348274 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 79/162] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:12.354221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d4cf-04c3-4298-9b1b-667fb085ac3e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:12.354580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d4cf-04c3-4298-9b1b-667fb085ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:12.354787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d4cf-04c3-4298-9b1b-667fb085ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:12.381098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5a66d4cf-04c3-4298-9b1b-667fb085ac3e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:12.383236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5a66d4cf-04c3-4298-9b1b-667fb085ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:12.411100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:12.516044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 84/163] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:12.691009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823e79-bc66-44a6-b32b-cc8f309c4cfb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:12.835264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:12.875697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823e79-bc66-44a6-b32b-cc8f309c4cfb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:12.918718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d4cf-04c3-4298-9b1b-667fb085ac3e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:12.935397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:12.936569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:12.937082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:12.937683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:12.946725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:12.950656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:12.951151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 80/164] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:12.957663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:13.094285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4f219-4c58-4438-959c-693aaf8117e3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:13.140800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:13.142755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.143666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.144238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.146019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:13.148586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:13.155186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d4cf-04c3-4298-9b1b-667fb085ac3e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:13.199216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 81/165] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:12 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:46:13.208635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dde80-bfe8-43db-aa55-091557cfb2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:13.209370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dde80-bfe8-43db-aa55-091557cfb2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.209651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dde80-bfe8-43db-aa55-091557cfb2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.209921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dde80-bfe8-43db-aa55-091557cfb2c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.224596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dde80-bfe8-43db-aa55-091557cfb2c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-eb2dde80-bfe8-43db-aa55-091557cfb2c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:13.231490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:13.232437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:13.233300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:13.233887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 85/166] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:13.244322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:13.249303 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:13.457339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c542c69-e04d-4397-afd6-045a910b77e8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:13.468402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3bb0a-03c6-474c-8a2b-0cbb04cd3a4c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.469489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3bb0a-03c6-474c-8a2b-0cbb04cd3a4c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.470244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3bb0a-03c6-474c-8a2b-0cbb04cd3a4c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.473365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 86/167] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:13.479083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7213e1b-a4c9-46e5-bc45-5d978724da8b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.479713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7213e1b-a4c9-46e5-bc45-5d978724da8b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.480206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7213e1b-a4c9-46e5-bc45-5d978724da8b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.482982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 87/168] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:13.484566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4ded5-01dd-4ba4-b317-b5a0db5834d8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.485156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4ded5-01dd-4ba4-b317-b5a0db5834d8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.485639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4ded5-01dd-4ba4-b317-b5a0db5834d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.506250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453b2d4-5700-4cd7-9125-f0d44c627927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:13.507095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b2d4-5700-4cd7-9125-f0d44c627927 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.507545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b2d4-5700-4cd7-9125-f0d44c627927 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.507979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453b2d4-5700-4cd7-9125-f0d44c627927 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.508882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453b2d4-5700-4cd7-9125-f0d44c627927 None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:13.509450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453b2d4-5700-4cd7-9125-f0d44c627927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:13.513015 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453b2d4-5700-4cd7-9125-f0d44c627927 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:13.519651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-13c4ded5-01dd-4ba4-b317-b5a0db5834d8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:13.521587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-13c4ded5-01dd-4ba4-b317-b5a0db5834d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:13.528167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 82/169] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:13.528985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:13.530298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed9449-e756-4f45-b171-6ea1d4af29f5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.530976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed9449-e756-4f45-b171-6ea1d4af29f5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.531484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed9449-e756-4f45-b171-6ea1d4af29f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.559157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e3ed9449-e756-4f45-b171-6ea1d4af29f5 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:13.561177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e3ed9449-e756-4f45-b171-6ea1d4af29f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:13.657790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 88/170] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:13.658817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4ded5-01dd-4ba4-b317-b5a0db5834d8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:13.682219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:13.704790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 83/171] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:13.841932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4ded5-01dd-4ba4-b317-b5a0db5834d8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:13.890054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:13.890743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:13.891018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:13.891280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] PATH_INFO: `/v3/users/662f594c85f24f13afb765afbd8b74f7` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:13.903833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:13.915353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] RBAC: Authorizing `identity:get_user(user_id=662f594c85f24f13afb765afbd8b74f7)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:13.916879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:13.920952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 89/172] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:13 2022] GET /identity/v3/users/662f594c85f24f13afb765afbd8b74f7 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:13.929918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed9449-e756-4f45-b171-6ea1d4af29f5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:14.102196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed9449-e756-4f45-b171-6ea1d4af29f5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:14.105941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:14.180919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:14.183043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:14.184683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:14.185706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:14.189166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:14.193124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:14.197041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 84/173] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:13 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:14.204402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:14.336049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:14.357296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce552da1-4e74-4d9b-abbb-3c2e2e3e8344 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:14.377595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d15b9-ed2d-4f7e-bff0-ef9c8bde4125 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:14.428528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:14.429927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:14.430736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:14.430930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:14.431533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:14.431814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:14.432085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:14.432414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/662f594c85f24f13afb765afbd8b74f7/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:14.437288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=eb55422b2fa54e5baef36f84f4fa45fb, user_id=662f594c85f24f13afb765afbd8b74f7, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:14.440930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:14.445890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:14.452583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:14.454878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:14.458451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 90/174] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:14.459734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:14.471974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 85/175] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:14 2022] PUT /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/662f594c85f24f13afb765afbd8b74f7/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:14.472917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:14.555399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:14.606899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85ef2-ec95-42cb-be38-f19c701d5a1c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:14.652715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:14.653700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:14.654143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:14.654586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:14.668814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:14.674691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:14.675836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:14.676817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:14.678991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 91/176] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:46:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:14.691799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:14.718577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48afaa6-515f-4219-a4a1-28a4d9e36a4c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:14.808172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:14.815946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:14.817109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:14.817578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:14.818175 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:14.819635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:14.820144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:14.822941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:14.839529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 86/177] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:14.850661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:14.932092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673202-3bfe-41cb-a2cb-1c26f053fbf9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:14.985263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:15.024110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:15.025579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:15.025935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:15.027136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:15.028092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:15.028424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:15.030178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:15.059743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 92/178] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:15.066816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:15.152969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef37271-06d2-4bcc-bd25-684eb5a3c623 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:15.199570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb6469-af97-456f-bbfd-8f573ad36ca7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:15.241450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:15.242113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:15.242391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:15.242693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] PATH_INFO: `/v3/users/d784d6c396f2465db5176c3a5c5d7af1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:15.244055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] RBAC: Authorizing `identity:get_user(user_id=d784d6c396f2465db5176c3a5c5d7af1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:15.245697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:15.247538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 93/179] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:15 2022] GET /identity/v3/users/d784d6c396f2465db5176c3a5c5d7af1 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:15.253430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:15.271948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:15.272624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:15.272978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:15.273294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] PATH_INFO: `/v3/users/d784d6c396f2465db5176c3a5c5d7af1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:15.279467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] RBAC: Authorizing `identity:get_user(user_id=d784d6c396f2465db5176c3a5c5d7af1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:15.281009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:15.282764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 87/180] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:14 2022] GET /identity/v3/users/d784d6c396f2465db5176c3a5c5d7af1 => generated 283 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:15.290087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:15.319724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:15.383520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88b0c1-00f6-4cfd-abda-e2455826ef29 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:15.426166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:15.426885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:15.427162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:15.427462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:15.442285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:15.516526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:15.518109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:15.583111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:15.608795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56deed8-b7b2-4caa-bb34-c88e7bf0630a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:15.643931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 94/181] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 11:46:15.649863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:15.733943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:15.735832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:15.735832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:15.735832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:15.803397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4272e53-284b-4bd1-a780-579cd266316e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:15.847690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:15.848360 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:15.848635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:15.849248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:15.850347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:15.852138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:15.853878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 95/182] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:15 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:15.860249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:15.891871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:15.931474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:15.933022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:15.996908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28b46c-57b4-45d5-9e51-d4ff781a1d5d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:16.055281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:16.098067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:16.099136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:16.099561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:16.099969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:16.100925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] RBAC: Adding query filter params (role.id=ba129f3d0c7c49f08f7334bbc914a775, scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb, user.id=d784d6c396f2465db5176c3a5c5d7af1) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:16.101486 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:16.103315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:16.118109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 96/183] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:15 2022] GET /identity/v3/role_assignments?user.id=d784d6c396f2465db5176c3a5c5d7af1&scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb&role.id=ba129f3d0c7c49f08f7334bbc914a775 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:16.154605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 88/184] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 865 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 11:46:16.164406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:16.354021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:16.380491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16741de-82d1-48c4-8eab-1ed5bc33db84 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:16.427328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c49fd-01e8-42a9-bdbf-c81a3995f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:16.428789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c49fd-01e8-42a9-bdbf-c81a3995f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:16.429268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c49fd-01e8-42a9-bdbf-c81a3995f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:16.429749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c49fd-01e8-42a9-bdbf-c81a3995f8b4 None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:16.435567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c49fd-01e8-42a9-bdbf-c81a3995f8b4 None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:16.437128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c49fd-01e8-42a9-bdbf-c81a3995f8b4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:16.439114 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 97/185] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:16 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:16.446686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:16.591546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed048-569e-4a1d-a229-935aa4b9df5c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:16.591892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed048-569e-4a1d-a229-935aa4b9df5c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:16.592206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed048-569e-4a1d-a229-935aa4b9df5c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:16.593634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 98/186] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:16.599459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546c2bf-4ab2-4582-8d9e-0b9ccdf6c0d0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:16.599780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546c2bf-4ab2-4582-8d9e-0b9ccdf6c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:16.600013 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546c2bf-4ab2-4582-8d9e-0b9ccdf6c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:16.619990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0546c2bf-4ab2-4582-8d9e-0b9ccdf6c0d0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:16.621386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0546c2bf-4ab2-4582-8d9e-0b9ccdf6c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:16.664193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ef714-e2f9-481a-973a-d1c94f67225c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:16.704924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ff633-c67b-4515-8b89-83e20b097476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:16.705665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff633-c67b-4515-8b89-83e20b097476 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:16.705941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff633-c67b-4515-8b89-83e20b097476 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:16.706207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ff633-c67b-4515-8b89-83e20b097476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:16.706985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ff633-c67b-4515-8b89-83e20b097476 None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb, user.id=d784d6c396f2465db5176c3a5c5d7af1) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:16.707291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ff633-c67b-4515-8b89-83e20b097476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:16.708763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ff633-c67b-4515-8b89-83e20b097476 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:16.714636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 99/187] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:16.716319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b6a67-969b-4877-b770-89edcf60342e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:16.716791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b6a67-969b-4877-b770-89edcf60342e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:16.717248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b6a67-969b-4877-b770-89edcf60342e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:16.718822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 100/188] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:16.730773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 89/189] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:16 2022] GET /identity/v3/role_assignments?user.id=d784d6c396f2465db5176c3a5c5d7af1&scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:16.734120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ff3a6-bf9c-4db2-bb4b-a6817cf315a1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:16.734969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ff3a6-bf9c-4db2-bb4b-a6817cf315a1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:16.735691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ff3a6-bf9c-4db2-bb4b-a6817cf315a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:16.771849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-344ff3a6-bf9c-4db2-bb4b-a6817cf315a1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:16.774279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-344ff3a6-bf9c-4db2-bb4b-a6817cf315a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:16.800417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:16.925336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 90/190] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:16.988852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b6a67-969b-4877-b770-89edcf60342e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:17.131983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:17.134322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf456c-e64d-48c9-9878-76872fa3df3b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.134843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf456c-e64d-48c9-9878-76872fa3df3b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.135316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf456c-e64d-48c9-9878-76872fa3df3b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.137542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 91/191] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:17.144287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3430491-0c52-4d60-b245-8bf017b0bc96 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.145461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3430491-0c52-4d60-b245-8bf017b0bc96 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.145746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3430491-0c52-4d60-b245-8bf017b0bc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.159643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b6a67-969b-4877-b770-89edcf60342e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:17.175829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e3430491-0c52-4d60-b245-8bf017b0bc96 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:17.177304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e3430491-0c52-4d60-b245-8bf017b0bc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:17.199789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:17.200494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.200899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.201080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.212938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:17.217965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:17.218931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:17.219682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:17.224106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 101/192] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:17.224993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:17.292402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 92/193] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:17.294505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3430491-0c52-4d60-b245-8bf017b0bc96 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:17.367615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b0b38-e09c-4a0f-a42d-ee057c17656e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:17.395478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:17.428614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:17.429951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.430393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.430984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.432905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:17.434071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3430491-0c52-4d60-b245-8bf017b0bc96 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:17.435550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:17.439481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 102/194] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:17.445109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:17.455381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:17.502013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:17.503424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.503906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.504378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.505672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:17.506183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:17.508929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:17.524309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 93/195] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:17.532830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:17.594645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2d0a3-f0e6-4149-8086-a551faf68289 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:17.640454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:17.641976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.642509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.643021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.643994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:17.646419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:17.681053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 103/196] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:17 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:46:17.682463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:17.703623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8ea8e-4eb9-4358-b470-220c9e44971a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:17.761462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:17.762854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.763421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.764050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] PATH_INFO: `/v3/users/9d663785eb644f26a35e937fdca9154c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.778869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:17.792168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] RBAC: Authorizing `identity:get_user(user_id=9d663785eb644f26a35e937fdca9154c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:17.795906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:17.806911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 94/197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:17 2022] GET /identity/v3/users/9d663785eb644f26a35e937fdca9154c => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:17.809735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:17.822948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:17.902423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91d4f-b16b-4b08-b2fd-2b4d360f8146 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:17.949445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:17.950173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:17.950454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:17.951201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:17.964989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:17.971734 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84e49b-6475-461b-a626-ed068f7d584f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:17.971915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:17.972751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:17.973519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:17.974088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 104/198] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:17.981262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:18.029947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:18.030843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:18.032033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:18.032033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:18.032797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:18.034432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:18.037186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 95/199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:17 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:18.043575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:18.129648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:18.137411 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae06fd-1291-46d5-bbec-ad305bcfae31 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:18.174204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:18.180587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a518f7-fb5d-4624-9528-e0d707869dd8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:18.194150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:18.195638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:18.196378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:18.197260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:18.199185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:18.199990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:18.203381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:18.221445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:18.222082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 105/200] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:18.222273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:18.222420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:18.222699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/9d663785eb644f26a35e937fdca9154c/roles/a0aaeb427bd246cb822d06423bbc4e53` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:18.224809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] RBAC: Authorizing `identity:create_grant(project_id=eb55422b2fa54e5baef36f84f4fa45fb, user_id=9d663785eb644f26a35e937fdca9154c, role_id=a0aaeb427bd246cb822d06423bbc4e53)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:18.226307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:18.228373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:18.244073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 96/201] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:18 2022] PUT /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/users/9d663785eb644f26a35e937fdca9154c/roles/a0aaeb427bd246cb822d06423bbc4e53 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:46:18.377335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3c386-c593-449c-916f-84b29a39f404 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:18.420096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:18.420783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:18.421056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:18.421324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] PATH_INFO: `/v3/users/662f594c85f24f13afb765afbd8b74f7` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:18.422658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=662f594c85f24f13afb765afbd8b74f7)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:18.424257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:18.426015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 106/202] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:18 2022] GET /identity/v3/users/662f594c85f24f13afb765afbd8b74f7 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:18.434369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:18.607232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde6b5-e98f-4448-8cff-cb86cd44ab3e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:18.650480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:18.669244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:18.670022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:18.670264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:18.670545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:18.775969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:18.777961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:18.900960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 97/203] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:18.909661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:18.991098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:19.044054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54f23-f982-43e9-9f23-5b9e79e3d3b8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:19.083004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76fd6d-8179-4b6f-aeb5-b0fb6ff08fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:19.083644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76fd6d-8179-4b6f-aeb5-b0fb6ff08fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:19.083919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76fd6d-8179-4b6f-aeb5-b0fb6ff08fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:19.084182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76fd6d-8179-4b6f-aeb5-b0fb6ff08fa5 None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:19.085359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76fd6d-8179-4b6f-aeb5-b0fb6ff08fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:19.086819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76fd6d-8179-4b6f-aeb5-b0fb6ff08fa5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:19.088498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 107/204] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:18 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:19.098151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:19.130159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:19.264081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0b814-c022-49d1-95e2-627d78432bc9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:19.310881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420813-6dbe-4608-8fcb-043de6bffa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:19.311515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420813-6dbe-4608-8fcb-043de6bffa36 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:19.311791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420813-6dbe-4608-8fcb-043de6bffa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:19.312058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420813-6dbe-4608-8fcb-043de6bffa36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:19.312800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420813-6dbe-4608-8fcb-043de6bffa36 None admin] RBAC: Adding query filter params (role.id=4b08dbe46a7c4b618462666ee2e4b395, scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb, user.id=662f594c85f24f13afb765afbd8b74f7) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:19.313105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420813-6dbe-4608-8fcb-043de6bffa36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:19.314603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420813-6dbe-4608-8fcb-043de6bffa36 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:19.321454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 98/205] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:19 2022] GET /identity/v3/role_assignments?user.id=662f594c85f24f13afb765afbd8b74f7&scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb&role.id=4b08dbe46a7c4b618462666ee2e4b395 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:20.425130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc3956-211d-432c-b03a-4075f2bb243d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:20.425683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc3956-211d-432c-b03a-4075f2bb243d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:20.425683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc3956-211d-432c-b03a-4075f2bb243d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:20.427253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 108/206] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:20.432925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070de9-a826-4ad3-bbb5-d243fbc2fac5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:20.433423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070de9-a826-4ad3-bbb5-d243fbc2fac5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:20.433688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19070de9-a826-4ad3-bbb5-d243fbc2fac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:20.435942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22181d84-3d6e-45e2-b1b4-64f448512fc6 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:20.436218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22181d84-3d6e-45e2-b1b4-64f448512fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:20.436514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22181d84-3d6e-45e2-b1b4-64f448512fc6 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:20.438206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 109/207] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:20.444421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409470-6166-4796-a682-fdf4c5d52496 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:20.444697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409470-6166-4796-a682-fdf4c5d52496 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:20.444962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79409470-6166-4796-a682-fdf4c5d52496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:20.454076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-19070de9-a826-4ad3-bbb5-d243fbc2fac5 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:20.455332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-19070de9-a826-4ad3-bbb5-d243fbc2fac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:20.463577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-79409470-6166-4796-a682-fdf4c5d52496 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:20.465132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-79409470-6166-4796-a682-fdf4c5d52496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:20.536269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 99/208] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:20.541446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 110/209] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:20.778852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249dd08-1191-4249-9b40-6af2d5dc75f4 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:20.779084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249dd08-1191-4249-9b40-6af2d5dc75f4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:20.779495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249dd08-1191-4249-9b40-6af2d5dc75f4 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:20.780913 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 100/210] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:20.786374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db476-6035-476b-96f3-b05508c1d4f3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:20.786717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db476-6035-476b-96f3-b05508c1d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:20.786969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db476-6035-476b-96f3-b05508c1d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:20.806037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249dd08-1191-4249-9b40-6af2d5dc75f4 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:20.806349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cd9db476-6035-476b-96f3-b05508c1d4f3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:20.807545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cd9db476-6035-476b-96f3-b05508c1d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:20.838091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:20.857574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:20.882134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 111/211] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:20.887635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db476-6035-476b-96f3-b05508c1d4f3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:20.945116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249dd08-1191-4249-9b40-6af2d5dc75f4 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.010433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.011138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.011472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.011755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.012966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:21.014686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:21.016622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 101/212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:21.022242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:21.022848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db476-6035-476b-96f3-b05508c1d4f3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.068062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.068635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.068908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.069173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.081961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:21.087340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:21.089202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:21.091272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 112/213] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:21.094644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:21.132331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:21.151059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cc482-db56-43ee-bfea-4d9f4e92ea0b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.167199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:21.186833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.187463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.187731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.188004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.188656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:21.190127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:21.213382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 102/214] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:21 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:46:21.214271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:21.286184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b891e6-47a6-48fb-b1a0-270194e48536 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.342154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.343490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.343783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.344067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.344727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:21.345291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:21.346859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:21.363955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 113/215] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:21.365357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:21.365533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288aa7e-ac50-42fe-8867-30050e00cb8c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.426363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.427579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.428061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.428505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.446968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:21.452722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:21.453629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:21.454373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 103/216] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:21.460189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:21.463309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:21.545564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648d03-c979-484e-bb5d-88f05a1ee91f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.547848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:21.604234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.605182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.605454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.605717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] PATH_INFO: `/v3/users/52adc88e9d164f73b246d522365ff5f4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.623049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecd998-8ce5-4b68-a76d-21800a2b8ea9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.626386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] RBAC: Authorizing `identity:get_user(user_id=52adc88e9d164f73b246d522365ff5f4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:21.628403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:21.630488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 114/217] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:21 2022] GET /identity/v3/users/52adc88e9d164f73b246d522365ff5f4 => generated 293 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:21.636339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:21.672261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.672916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.673190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.673457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.674156 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:21.674451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:21.675986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:21.690592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 104/218] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:21.704154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:21.788772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009842ea-3344-4799-b4ab-a8749d3309db None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.843630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:21.853167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.854413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.854989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.855623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.858958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] RBAC: Adding query filter params (role.id=4b08dbe46a7c4b618462666ee2e4b395, user.id=52adc88e9d164f73b246d522365ff5f4, scope.system=all) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:21.859515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:21.860873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:21.877296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 115/219] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Oct 11 11:46:21 2022] GET /identity/v3/role_assignments?user.id=52adc88e9d164f73b246d522365ff5f4&scope.system=all&role.id=4b08dbe46a7c4b618462666ee2e4b395 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:21.907702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d4310-19c8-43ca-b788-77b5e6e1a39d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:21.970153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:21.971240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:21.971522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:21.971788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] PATH_INFO: `/v3/users/9d663785eb644f26a35e937fdca9154c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:21.973111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=9d663785eb644f26a35e937fdca9154c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:21.976188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:21.976718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 105/220] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:21 2022] GET /identity/v3/users/9d663785eb644f26a35e937fdca9154c => generated 297 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:21.990638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:22.021014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:22.117607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93ff31-a500-4755-b8f0-60c8e9489621 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:22.156032 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:22.156655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:22.156960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:22.157229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:22.237002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:22.238602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:22.267978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:22.356203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 116/221] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:22.362408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:22.540489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e1b7-88e7-4acd-9407-73e316122ed4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:22.594933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:22.602728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45968e34-4fbc-4769-883a-02cc04f59a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:22.603690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968e34-4fbc-4769-883a-02cc04f59a55 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:22.604111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968e34-4fbc-4769-883a-02cc04f59a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:22.604525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45968e34-4fbc-4769-883a-02cc04f59a55 None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:22.606480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45968e34-4fbc-4769-883a-02cc04f59a55 None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:22.609187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45968e34-4fbc-4769-883a-02cc04f59a55 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:22.612465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 106/222] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:22 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:22.619493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:22.745823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267cb80-271c-4075-a4d9-c3edcb5a3421 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:22.773979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:22.787159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c19f3-441f-49a8-aad9-4cff05432207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:22.788182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c19f3-441f-49a8-aad9-4cff05432207 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:22.788678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c19f3-441f-49a8-aad9-4cff05432207 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:22.789193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c19f3-441f-49a8-aad9-4cff05432207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:22.790176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c19f3-441f-49a8-aad9-4cff05432207 None admin] RBAC: Adding query filter params (role.id=a0aaeb427bd246cb822d06423bbc4e53, scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb, user.id=9d663785eb644f26a35e937fdca9154c) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:22.790792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c19f3-441f-49a8-aad9-4cff05432207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:22.792558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c19f3-441f-49a8-aad9-4cff05432207 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:22.800302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 117/223] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:46:22 2022] GET /identity/v3/role_assignments?user.id=9d663785eb644f26a35e937fdca9154c&scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb&role.id=a0aaeb427bd246cb822d06423bbc4e53 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:23.672969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0914-46b0-488d-86c4-af5fe4bfc84f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:23.673797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0914-46b0-488d-86c4-af5fe4bfc84f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:23.673797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0914-46b0-488d-86c4-af5fe4bfc84f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:23.675538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 107/224] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:23.681861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93ca65-0f47-4edb-8e9c-51d0ca7faff3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:23.682716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93ca65-0f47-4edb-8e9c-51d0ca7faff3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:23.682850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93ca65-0f47-4edb-8e9c-51d0ca7faff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:23.702719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1f93ca65-0f47-4edb-8e9c-51d0ca7faff3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:23.704206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1f93ca65-0f47-4edb-8e9c-51d0ca7faff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:23.707189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7229bf0-8adc-4225-8c0e-388499cb1266 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:23.707533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7229bf0-8adc-4225-8c0e-388499cb1266 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:23.707834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7229bf0-8adc-4225-8c0e-388499cb1266 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:23.709282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 108/225] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:23.714894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8c4c-6b2e-4c5d-b165-ef22508b03f1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:23.715273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8c4c-6b2e-4c5d-b165-ef22508b03f1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:23.715451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8c4c-6b2e-4c5d-b165-ef22508b03f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:23.734999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a4de8c4c-6b2e-4c5d-b165-ef22508b03f1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:23.736222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a4de8c4c-6b2e-4c5d-b165-ef22508b03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:23.821187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 118/226] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:23.839454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 109/227] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:24.097745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93ca65-0f47-4edb-8e9c-51d0ca7faff3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:24.201929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93ca65-0f47-4edb-8e9c-51d0ca7faff3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:24.220164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:24.238762 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:24.239320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.239588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.239846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.250451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:24.255288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:24.256186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:24.259371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 119/228] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:24.262409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de8c4c-6b2e-4c5d-b165-ef22508b03f1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:24.328420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:24.371616 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de8c4c-6b2e-4c5d-b165-ef22508b03f1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:24.408635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:24.420209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:24.421782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.422270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.422794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.424483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:24.425380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:24.427767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:24.447659 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 110/229] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:24.448776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d52a-2f5b-454b-856a-a309f9354319 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:24.449587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:24.490115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:24.490710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.490975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.491259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.492408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:24.493896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:24.495572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 120/230] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:24.504402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:24.567919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:24.582191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c71555-38a6-48ed-90ea-851e9ff8b781 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:24.623235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:24.624168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.624582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.624964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] PATH_INFO: `/v3/users/c3c7397b1a334778ac42b97985f488b4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.637307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1246b-5f95-48bc-a591-48c86da6ed0d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:24.643611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] RBAC: Authorizing `identity:get_user(user_id=c3c7397b1a334778ac42b97985f488b4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:24.645343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:24.647560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 111/231] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:24 2022] GET /identity/v3/users/c3c7397b1a334778ac42b97985f488b4 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:24.655013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:24.681692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d8526-34fd-4987-900d-5b8332499e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:24.682434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8526-34fd-4987-900d-5b8332499e0a None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.683196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8526-34fd-4987-900d-5b8332499e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.683196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d8526-34fd-4987-900d-5b8332499e0a None admin] PATH_INFO: `/v3/groups` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.683793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d8526-34fd-4987-900d-5b8332499e0a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:24.685422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d8526-34fd-4987-900d-5b8332499e0a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:24.710869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 121/232] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Oct 11 11:46:24 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:46:24.723774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:24.792052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b203b8-91b7-41d6-b66a-312ad8b21b56 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:24.839405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c54e-9519-4428-a5f1-b1276f71b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:24.840244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c54e-9519-4428-a5f1-b1276f71b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.840688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c54e-9519-4428-a5f1-b1276f71b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.841109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c54e-9519-4428-a5f1-b1276f71b9f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.842013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c54e-9519-4428-a5f1-b1276f71b9f3 None admin] RBAC: Adding query filter params (role.id=a0aaeb427bd246cb822d06423bbc4e53, user.id=c3c7397b1a334778ac42b97985f488b4, scope.system=all) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:24.842464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c54e-9519-4428-a5f1-b1276f71b9f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:24.844176 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c54e-9519-4428-a5f1-b1276f71b9f3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:24.851063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 112/233] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Oct 11 11:46:24 2022] GET /identity/v3/role_assignments?user.id=c3c7397b1a334778ac42b97985f488b4&scope.system=all&role.id=a0aaeb427bd246cb822d06423bbc4e53 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:24.941656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d602bd-91d0-4efe-be21-46febc3f6652 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.942099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d602bd-91d0-4efe-be21-46febc3f6652 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.942527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d602bd-91d0-4efe-be21-46febc3f6652 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.944972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 122/234] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:24.951425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b30e0-4b6f-453d-b101-2ebd1cd8fd2a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:24.951726 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b30e0-4b6f-453d-b101-2ebd1cd8fd2a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:24.952012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b30e0-4b6f-453d-b101-2ebd1cd8fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:24.980098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3d3b30e0-4b6f-453d-b101-2ebd1cd8fd2a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:24.981451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3d3b30e0-4b6f-453d-b101-2ebd1cd8fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:25.069368 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 113/235] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:25.335416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d602bd-91d0-4efe-be21-46febc3f6652 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:25.447203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d602bd-91d0-4efe-be21-46febc3f6652 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:25.454783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:25.487525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:25.488174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:25.488519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:25.488791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:25.500802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:25.505957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:25.507278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:25.508127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:25.511252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 123/236] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:25.514017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b30e0-4b6f-453d-b101-2ebd1cd8fd2a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:25.568288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:25.642324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b30e0-4b6f-453d-b101-2ebd1cd8fd2a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:25.689972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:25.690630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:25.690915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:25.691181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:25.691964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:25.692263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:25.693749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:25.703804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 114/237] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:25.710397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:25.859246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4a072-7d9d-4565-8a81-eaca45d9d6df None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:25.920444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c552e5-44eb-4c22-875c-0aec21b1c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:25.921806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c552e5-44eb-4c22-875c-0aec21b1c864 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:25.922131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c552e5-44eb-4c22-875c-0aec21b1c864 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:25.922672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c552e5-44eb-4c22-875c-0aec21b1c864 None admin] PATH_INFO: `/v3/users/52adc88e9d164f73b246d522365ff5f4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:25.925092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c552e5-44eb-4c22-875c-0aec21b1c864 None admin] RBAC: Authorizing `identity:get_user(user_id=52adc88e9d164f73b246d522365ff5f4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:25.928058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c552e5-44eb-4c22-875c-0aec21b1c864 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:25.931069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 124/238] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:25 2022] GET /identity/v3/users/52adc88e9d164f73b246d522365ff5f4 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:25.937318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:26.082764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0a5be-a2ee-4183-bbb3-114020c4e076 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:26.090968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:26.124216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d15a9d-bb2e-4c23-bb09-2b785cfb58be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:26.124872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d15a9d-bb2e-4c23-bb09-2b785cfb58be None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:26.125142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d15a9d-bb2e-4c23-bb09-2b785cfb58be None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:26.125412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d15a9d-bb2e-4c23-bb09-2b785cfb58be None admin] PATH_INFO: `/v3/system/users/52adc88e9d164f73b246d522365ff5f4/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:26.126873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d15a9d-bb2e-4c23-bb09-2b785cfb58be None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=52adc88e9d164f73b246d522365ff5f4, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:26.128295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d15a9d-bb2e-4c23-bb09-2b785cfb58be None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:26.141479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 115/239] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Oct 11 11:46:25 2022] PUT /identity/v3/system/users/52adc88e9d164f73b246d522365ff5f4/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:46:27.228518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b925-713b-46c8-8894-46f6dd72e159 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:27.229312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b925-713b-46c8-8894-46f6dd72e159 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:27.229312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b925-713b-46c8-8894-46f6dd72e159 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:27.230815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 125/240] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:27.236190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6beee-c61f-416b-91ff-0cda53d3d411 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:27.236880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6beee-c61f-416b-91ff-0cda53d3d411 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:27.236880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6beee-c61f-416b-91ff-0cda53d3d411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:27.256636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1ac6beee-c61f-416b-91ff-0cda53d3d411 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:27.257821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1ac6beee-c61f-416b-91ff-0cda53d3d411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:27.274093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895e32-775c-4e1a-8076-ed4e3fb665fb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:27.274378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895e32-775c-4e1a-8076-ed4e3fb665fb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:27.274671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895e32-775c-4e1a-8076-ed4e3fb665fb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:27.276497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 126/241] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:27.285308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266a9d-c792-4030-9bfc-49d016187b3c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:27.285591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266a9d-c792-4030-9bfc-49d016187b3c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:27.285925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266a9d-c792-4030-9bfc-49d016187b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:27.308899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-96266a9d-c792-4030-9bfc-49d016187b3c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:27.310126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-96266a9d-c792-4030-9bfc-49d016187b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:27.343930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:27.350598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 116/242] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:27.401672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 127/243] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:27.622873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6beee-c61f-416b-91ff-0cda53d3d411 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:27.714465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96266a9d-c792-4030-9bfc-49d016187b3c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:27.731525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:27.735823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6beee-c61f-416b-91ff-0cda53d3d411 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:27.778078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:27.778763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:27.779066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:27.779439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:27.780594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:27.782049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:27.783942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 117/244] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:27.789964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:27.839558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96266a9d-c792-4030-9bfc-49d016187b3c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:27.882520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:27.883168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:27.883479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:27.883781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:27.896820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:27.902751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:27.903770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:27.904538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 128/245] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:27.910709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:27.920247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61401c2-60fa-420f-9253-de4035c2e1c9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:27.943177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:27.978936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:27.979720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:27.980145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:27.980526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] PATH_INFO: `/v3/groups` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:27.981657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:27.983668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:28.010033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 118/246] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Oct 11 11:46:27 2022] POST /identity/v3/groups => generated 226 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:46:28.059971 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb5d1-90e2-4104-bd8c-28d6ab83977b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:28.100975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:28.101598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:28.101865 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:28.102122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:28.102871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:28.103212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:28.104800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:28.115002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 129/247] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:28.121786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:28.173852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:28.288652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa0dae-1cda-4d3b-9ab1-5e2bb30c0f3b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:28.340468 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53254b8-c95e-42e7-a4f1-7a675e98e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:28.341542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53254b8-c95e-42e7-a4f1-7a675e98e5fc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:28.341980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53254b8-c95e-42e7-a4f1-7a675e98e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:28.342436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53254b8-c95e-42e7-a4f1-7a675e98e5fc None admin] PATH_INFO: `/v3/users/c3c7397b1a334778ac42b97985f488b4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:28.343835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53254b8-c95e-42e7-a4f1-7a675e98e5fc None admin] RBAC: Authorizing `identity:get_user(user_id=c3c7397b1a334778ac42b97985f488b4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:28.346274 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53254b8-c95e-42e7-a4f1-7a675e98e5fc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:28.349199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 119/248] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:28 2022] GET /identity/v3/users/c3c7397b1a334778ac42b97985f488b4 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:28.356157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:28.379803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4873d-8428-4d57-b443-6697895ff2e3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:28.380239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4873d-8428-4d57-b443-6697895ff2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:28.380673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4873d-8428-4d57-b443-6697895ff2e3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:28.383259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 120/249] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:28.392726 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3332f-d8e1-4223-8601-b07d5ed5b19d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:28.393154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3332f-d8e1-4223-8601-b07d5ed5b19d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:28.393578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3332f-d8e1-4223-8601-b07d5ed5b19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:28.422835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-16f3332f-d8e1-4223-8601-b07d5ed5b19d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:28.424815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-16f3332f-d8e1-4223-8601-b07d5ed5b19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:28.515846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:28.536423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab265cac-be43-4ffb-abfa-fd62ddd5a506 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:28.551080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 121/250] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:28.594651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:28.595689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:28.596138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:28.596646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] PATH_INFO: `/v3/system/users/c3c7397b1a334778ac42b97985f488b4/roles/a0aaeb427bd246cb822d06423bbc4e53` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:28.598367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c3c7397b1a334778ac42b97985f488b4, role_id=a0aaeb427bd246cb822d06423bbc4e53)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:28.600123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:28.612031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 130/251] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Oct 11 11:46:28 2022] PUT /identity/v3/system/users/c3c7397b1a334778ac42b97985f488b4/roles/a0aaeb427bd246cb822d06423bbc4e53 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:29.055140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3332f-d8e1-4223-8601-b07d5ed5b19d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:29.094965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:29.207743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3332f-d8e1-4223-8601-b07d5ed5b19d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:29.258716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:29.259735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:29.260209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:29.260706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:29.275222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:29.281034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:29.282048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:29.282873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:29.285289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 122/252] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:29.291647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:29.413905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b6d63-bd5c-4eeb-b53f-beed35a744e1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:29.456842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:29.457826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:29.458301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:29.458824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:29.459708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:29.460226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:29.461852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:29.473931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 131/253] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:29.480888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:29.604114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:29.622800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0c6b-31a5-422f-991b-bc3c9eea62e3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:29.667066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ade20f-5343-4a60-b9fd-db91efc024b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:29.667762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade20f-5343-4a60-b9fd-db91efc024b4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:29.668352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade20f-5343-4a60-b9fd-db91efc024b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:29.668621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ade20f-5343-4a60-b9fd-db91efc024b4 None admin] PATH_INFO: `/v3/users/52adc88e9d164f73b246d522365ff5f4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:29.669855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ade20f-5343-4a60-b9fd-db91efc024b4 None admin] RBAC: Authorizing `identity:get_user(user_id=52adc88e9d164f73b246d522365ff5f4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:29.671384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ade20f-5343-4a60-b9fd-db91efc024b4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:29.673073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 123/254] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:29 2022] GET /identity/v3/users/52adc88e9d164f73b246d522365ff5f4 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:29.679270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:29.697252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:29.803159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca31a37-2efa-4386-a1e1-124f8936ceb1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:29.848839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44a783-5384-4362-858b-b896e6e7fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:29.849473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44a783-5384-4362-858b-b896e6e7fa04 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:29.849749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44a783-5384-4362-858b-b896e6e7fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:29.850021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44a783-5384-4362-858b-b896e6e7fa04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:29.850820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44a783-5384-4362-858b-b896e6e7fa04 None admin] RBAC: Adding query filter params (role.id=4b08dbe46a7c4b618462666ee2e4b395, user.id=52adc88e9d164f73b246d522365ff5f4, scope.system=all) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:29.851150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44a783-5384-4362-858b-b896e6e7fa04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:29.852646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44a783-5384-4362-858b-b896e6e7fa04 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:29.866652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 132/255] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Oct 11 11:46:29 2022] GET /identity/v3/role_assignments?user.id=52adc88e9d164f73b246d522365ff5f4&scope.system=all&role.id=4b08dbe46a7c4b618462666ee2e4b395 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:31.211994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe8447-87e0-40ec-83ac-f9fa2fa8fa0b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.212505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe8447-87e0-40ec-83ac-f9fa2fa8fa0b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.212505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe8447-87e0-40ec-83ac-f9fa2fa8fa0b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.214145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 124/256] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:31.220170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdff600-979c-4196-a54d-733bd5ff555d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.220651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdff600-979c-4196-a54d-733bd5ff555d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.220752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdff600-979c-4196-a54d-733bd5ff555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.242192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8bdff600-979c-4196-a54d-733bd5ff555d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:31.243390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8bdff600-979c-4196-a54d-733bd5ff555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:31.311510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 133/257] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 11 11:46:31.587437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe8447-87e0-40ec-83ac-f9fa2fa8fa0b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:31.602194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe8447-87e0-40ec-83ac-f9fa2fa8fa0b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:31.607078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:31.607737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.608010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.608280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.620706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:31.625796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:31.626741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:31.627540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 125/258] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 11 11:46:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:31.633375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdff600-979c-4196-a54d-733bd5ff555d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:31.643426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdff600-979c-4196-a54d-733bd5ff555d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:31.649161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:31.649828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.650107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.650372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.651105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:31.651407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:31.653372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:46:31.653372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:46:31.653372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:46:31.654265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:31.664616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 134/259] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:46:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:31.670776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:31.681882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ffd1-1661-4b22-b873-fb6f84ecc654 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:31.686824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:31.687494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.687770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.688031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.695776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:31.697646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:46:31.697646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 11:46:31.697646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 11:46:31.699257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:31.700919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 126/260] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 11 11:46:31 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:31.707128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:31.718133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ca24f-ea29-4c0c-88ea-c18b8daa7731 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:31.722931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546596ec-19eb-4a92-993a-3de75dc47cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:31.723584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546596ec-19eb-4a92-993a-3de75dc47cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.723862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546596ec-19eb-4a92-993a-3de75dc47cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.724132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546596ec-19eb-4a92-993a-3de75dc47cbd admin admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.725322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546596ec-19eb-4a92-993a-3de75dc47cbd admin admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:31.727476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546596ec-19eb-4a92-993a-3de75dc47cbd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:31.729206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 135/261] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 11 11:46:31 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:31.737264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:31.747913 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc514bc-d86c-4705-a9d0-af8df9390fde admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:31.752572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b756c71-4418-4e42-b37b-ed7e277bc4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:31.753254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b756c71-4418-4e42-b37b-ed7e277bc4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.753531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b756c71-4418-4e42-b37b-ed7e277bc4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.753795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b756c71-4418-4e42-b37b-ed7e277bc4d3 admin admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a/groups/29cf752f69d349edb698f58014326d7b/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.760435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b756c71-4418-4e42-b37b-ed7e277bc4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db0c2d2975949bdb6306acd527d555a, group_id=29cf752f69d349edb698f58014326d7b, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:31.761544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-8b756c71-4418-4e42-b37b-ed7e277bc4d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:46:31.761544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 11:46:31.761544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 11:46:31.763579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b756c71-4418-4e42-b37b-ed7e277bc4d3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:31.782608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 127/262] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 11 11:46:31 2022] PUT /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a/groups/29cf752f69d349edb698f58014326d7b/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:31.806667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e00b1-3a74-4a4c-9b10-dfad37e611fd None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.807005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e00b1-3a74-4a4c-9b10-dfad37e611fd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.807220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e00b1-3a74-4a4c-9b10-dfad37e611fd None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.808982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 136/263] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:31.815703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedec-2826-4547-a5b5-120f7e34c114 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:31.816061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedec-2826-4547-a5b5-120f7e34c114 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:31.816296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fedec-2826-4547-a5b5-120f7e34c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:31.839558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8c7fedec-2826-4547-a5b5-120f7e34c114 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:31.840940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8c7fedec-2826-4547-a5b5-120f7e34c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:31.915352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 128/264] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 11:46:32.372717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e00b1-3a74-4a4c-9b10-dfad37e611fd None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:32.380317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:32.390366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e00b1-3a74-4a4c-9b10-dfad37e611fd None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:32.395128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:32.395778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:32.396054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:32.396325 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:32.413176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:32.418626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:32.420772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:32.422758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 137/265] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 11 11:46:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:32.431028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedec-2826-4547-a5b5-120f7e34c114 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:32.456804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fedec-2826-4547-a5b5-120f7e34c114 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:32.470807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:32.471783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:32.472243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:32.472689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:32.473893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:32.474506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:32.476669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:46:32.476669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 11:46:32.476669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 11:46:32.478374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:32.504949 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 129/266] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 11 11:46:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:32.513718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:32.525597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbc0e3-98ce-419c-8be6-bc9669f4c474 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:32.539634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f214f4-e3e5-4832-9096-2d94724676f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:32.540457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f214f4-e3e5-4832-9096-2d94724676f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:32.540734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f214f4-e3e5-4832-9096-2d94724676f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:32.541006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f214f4-e3e5-4832-9096-2d94724676f8 admin admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:32.542280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f214f4-e3e5-4832-9096-2d94724676f8 admin admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:32.543672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-c4f214f4-e3e5-4832-9096-2d94724676f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:46:32.543672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:46:32.543672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:46:32.545028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f214f4-e3e5-4832-9096-2d94724676f8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:32.546790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 138/267] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 11 11:46:32 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:32.553430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:32.562795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42910bf6-f0ae-4bf5-9d16-30ae637d8015 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:32.563104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42910bf6-f0ae-4bf5-9d16-30ae637d8015 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:32.563334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42910bf6-f0ae-4bf5-9d16-30ae637d8015 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:32.565081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 139/268] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:32.571823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323481fb-5481-4b2d-b1b8-238f1ee816d4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:32.571823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323481fb-5481-4b2d-b1b8-238f1ee816d4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:32.571823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323481fb-5481-4b2d-b1b8-238f1ee816d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:32.580920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdce68-1bb9-4d7b-8d2a-19933a181d6e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:32.595074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:32.596203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:32.596647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:32.597111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:32.599421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:32.601798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-323481fb-5481-4b2d-b1b8-238f1ee816d4 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:32.603164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-323481fb-5481-4b2d-b1b8-238f1ee816d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:32.603398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:32.612291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 130/269] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 11 11:46:32 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:32.614134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:32.646452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba08190-ba73-4110-90d7-cd416816257d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:32.676720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:32.677811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:32.678267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:32.678778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a/groups/29cf752f69d349edb698f58014326d7b/roles/ba129f3d0c7c49f08f7334bbc914a775` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:32.692060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db0c2d2975949bdb6306acd527d555a, group_id=29cf752f69d349edb698f58014326d7b, role_id=ba129f3d0c7c49f08f7334bbc914a775)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:32.697186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:32.742843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 131/270] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 11 11:46:32 2022] PUT /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a/groups/29cf752f69d349edb698f58014326d7b/roles/ba129f3d0c7c49f08f7334bbc914a775 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:46:32.753492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 140/271] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:33.336559 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:33.433572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:33.575426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e491a0-1eb6-48ce-ba32-d011ef85a58d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:33.657483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34828d-b880-49ff-8353-2f628a5fb1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:33.658481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34828d-b880-49ff-8353-2f628a5fb1ec None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:33.659005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34828d-b880-49ff-8353-2f628a5fb1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:33.659482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34828d-b880-49ff-8353-2f628a5fb1ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:33.686657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34828d-b880-49ff-8353-2f628a5fb1ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-9c34828d-b880-49ff-8353-2f628a5fb1ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:33.699218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:33.700266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 11 11:46:33.701128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:33.706762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 132/272] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:33.709416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323481fb-5481-4b2d-b1b8-238f1ee816d4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:33.782340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ccf73-4838-4501-92cb-073bca72d26e None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:33.782829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ccf73-4838-4501-92cb-073bca72d26e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:33.783323 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ccf73-4838-4501-92cb-073bca72d26e None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:33.786346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 133/273] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:33.806324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92312241-4e36-4542-9b67-fb7969a7f3e5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:33.806864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92312241-4e36-4542-9b67-fb7969a7f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:33.807361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92312241-4e36-4542-9b67-fb7969a7f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:33.853207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-92312241-4e36-4542-9b67-fb7969a7f3e5 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:33.855868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-92312241-4e36-4542-9b67-fb7969a7f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:34.024718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 134/274] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 11 11:46:34.053745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323481fb-5481-4b2d-b1b8-238f1ee816d4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:34.086752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:34.115681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30722-6e3e-4936-bc2e-c787fcdce988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:34.116329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30722-6e3e-4936-bc2e-c787fcdce988 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.116605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30722-6e3e-4936-bc2e-c787fcdce988 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.116881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30722-6e3e-4936-bc2e-c787fcdce988 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.117577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30722-6e3e-4936-bc2e-c787fcdce988 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:34.117871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30722-6e3e-4936-bc2e-c787fcdce988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:34.119309 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30722-6e3e-4936-bc2e-c787fcdce988 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:34.136194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 141/275] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:34.142905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92312241-4e36-4542-9b67-fb7969a7f3e5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:34.250353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de465e6-1655-46f9-857a-74681a5fcd05 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.250732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de465e6-1655-46f9-857a-74681a5fcd05 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.250914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de465e6-1655-46f9-857a-74681a5fcd05 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.252464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 142/276] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:34.268754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255165-843c-45f7-81c9-39c6854c9439 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.268946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:34.269048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255165-843c-45f7-81c9-39c6854c9439 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.269048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255165-843c-45f7-81c9-39c6854c9439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.312928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f4255165-843c-45f7-81c9-39c6854c9439 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:34.314222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f4255165-843c-45f7-81c9-39c6854c9439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:34.341192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 143/277] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 11 11:46:34.399712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92312241-4e36-4542-9b67-fb7969a7f3e5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:34.478633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baef4e-0d74-49b9-adf3-d91a5fa9b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:34.479989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baef4e-0d74-49b9-adf3-d91a5fa9b31c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.480477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baef4e-0d74-49b9-adf3-d91a5fa9b31c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.481007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baef4e-0d74-49b9-adf3-d91a5fa9b31c None admin] PATH_INFO: `/v3/users/c3c7397b1a334778ac42b97985f488b4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.483672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baef4e-0d74-49b9-adf3-d91a5fa9b31c None admin] RBAC: Authorizing `identity:get_user(user_id=c3c7397b1a334778ac42b97985f488b4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:34.489102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baef4e-0d74-49b9-adf3-d91a5fa9b31c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:34.492561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 135/278] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:46:34 2022] GET /identity/v3/users/c3c7397b1a334778ac42b97985f488b4 => generated 293 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:34.503053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255165-843c-45f7-81c9-39c6854c9439 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:34.651799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cff03-1332-4694-9e63-065ef36596d9 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.652283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cff03-1332-4694-9e63-065ef36596d9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.652754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cff03-1332-4694-9e63-065ef36596d9 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.655395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 136/279] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:34.662321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889732-c21a-470e-a49b-63b94631ecb6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.662793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889732-c21a-470e-a49b-63b94631ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.663255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a889732-c21a-470e-a49b-63b94631ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.707637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9a889732-c21a-470e-a49b-63b94631ecb6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:34.708871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9a889732-c21a-470e-a49b-63b94631ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:34.728270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 137/280] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 11 11:46:34.735833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255165-843c-45f7-81c9-39c6854c9439 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:34.804236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a889732-c21a-470e-a49b-63b94631ecb6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:34.805071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:34.806096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.806595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.807072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.808586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] RBAC: Adding query filter params (role.id=a0aaeb427bd246cb822d06423bbc4e53, user.id=c3c7397b1a334778ac42b97985f488b4, scope.system=all) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:34.809202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:34.811926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:34.824925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a889732-c21a-470e-a49b-63b94631ecb6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:34.836303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 144/281] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Oct 11 11:46:34 2022] GET /identity/v3/role_assignments?user.id=c3c7397b1a334778ac42b97985f488b4&scope.system=all&role.id=a0aaeb427bd246cb822d06423bbc4e53 => generated 510 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:34.836615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:34.837270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.837545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.837810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.871826 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:34.876966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:34.879476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:34.881385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 138/282] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 11 11:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:34.890408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:34.917434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567baea-aa22-48d3-9f50-e0fc95c57da2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:34.929385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:34.930428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.930885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.931283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:34.932402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:34.933181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:34.936526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:34.954824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 145/283] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:46:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:34.964603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:34.986608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3b3ba-525d-4cd0-b342-b9b6fc11c0ca admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:34.998373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:34.999162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:34.999438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:34.999707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.002738 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.004800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.009255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 139/284] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 11 11:46:34 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:35.011577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.015678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.034768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28db47f-1f70-439c-b12f-ccb341cd40e8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.036901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abdcdd-ba26-458b-ab9f-902382f936c6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.043638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.045103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.045564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.046081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.047439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.048158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.048436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.048708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.051695 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.053900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.056015 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 140/285] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:35.062994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.074862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:35.085372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad294-651c-41bd-a94f-64e6265345ed admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:35.086478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:35.088576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:35.090547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 146/286] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:35.097006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.097358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.097712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.097989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.098257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/groups/29cf752f69d349edb698f58014326d7b/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.102712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb55422b2fa54e5baef36f84f4fa45fb, group_id=29cf752f69d349edb698f58014326d7b, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.105670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.126592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f039ad7-a3e3-4cc9-b48d-abd7c125beaf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.130919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 141/287] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 11 11:46:35 2022] PUT /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/groups/29cf752f69d349edb698f58014326d7b/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:46:35.149318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:35.170482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.269596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.270231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.270509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.270912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.271492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:35.271795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.273499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.292504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 147/288] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:35.298765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.312787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf397-4e4d-4e3d-9277-c64ca9b9189c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.326227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.326937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.327206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.327472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.328666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.330682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.332407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 148/289] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:35.338368 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56479fe-540e-40d9-8f4a-09ac1aaa135a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.339780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.357070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.360016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.360795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.362284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.382323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31175e-1814-4081-b28a-9dbd21486822 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.396149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.397574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.397982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:35.398622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.399413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.401951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:35.403778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:35.411148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:35.411924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 142/290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:35.413498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.417108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 149/291] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:35.417341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.423664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.432609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595b91-fc53-48af-861c-a5fe9b8211a3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.445614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5218d1a-7671-4c4a-bb9f-97cffbd63a59 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.446197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.447075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.447529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.447998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.448945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:35.449425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.451334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.453955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.455281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.455828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.456302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/groups/29cf752f69d349edb698f58014326d7b/roles/ba129f3d0c7c49f08f7334bbc914a775` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.462529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb55422b2fa54e5baef36f84f4fa45fb, group_id=29cf752f69d349edb698f58014326d7b, role_id=ba129f3d0c7c49f08f7334bbc914a775)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.463439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 143/292] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:35.466718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:46:35.466718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:46:35.466718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:46:35.469105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.470573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.487592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddef5e-9b45-4164-b1c9-5d1bfd7428cd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.496146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:35.501412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 150/293] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 11 11:46:35 2022] PUT /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb/groups/29cf752f69d349edb698f58014326d7b/roles/ba129f3d0c7c49f08f7334bbc914a775 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:35.575406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.576014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.576293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.576572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] PATH_INFO: `/v3/groups/645dcac893284e2eb9e3f77cb1da4fc8` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.583502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] RBAC: Authorizing `identity:get_group(group_id=645dcac893284e2eb9e3f77cb1da4fc8)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.585658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.587887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 144/294] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/groups/645dcac893284e2eb9e3f77cb1da4fc8 => generated 229 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:35.595418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.622943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c23cc-4a8e-4fc8-b369-9b63efc26507 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.634856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9899-c1dc-4ea2-bb75-de4a6267605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.636472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9899-c1dc-4ea2-bb75-de4a6267605e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.637230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9899-c1dc-4ea2-bb75-de4a6267605e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.638155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9899-c1dc-4ea2-bb75-de4a6267605e admin admin] PATH_INFO: `/v3/projects/be0e0b74041048e6a742ee9441a4f3f2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.640745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae9899-c1dc-4ea2-bb75-de4a6267605e admin admin] RBAC: Authorizing `identity:get_project(project_id=be0e0b74041048e6a742ee9441a4f3f2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.644738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae9899-c1dc-4ea2-bb75-de4a6267605e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.653480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 151/295] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 11 11:46:35 2022] GET /identity/v3/projects/be0e0b74041048e6a742ee9441a4f3f2 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:35.659181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:35.676998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d6a42-3d1b-4a7e-b21a-d80f966e48b7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:35.683393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd553217-dd1d-4146-91ea-780068ff1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:35.684031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553217-dd1d-4146-91ea-780068ff1071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:35.684360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553217-dd1d-4146-91ea-780068ff1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:35.684683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553217-dd1d-4146-91ea-780068ff1071 admin admin] PATH_INFO: `/v3/projects/be0e0b74041048e6a742ee9441a4f3f2/groups/645dcac893284e2eb9e3f77cb1da4fc8/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:35.692503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd553217-dd1d-4146-91ea-780068ff1071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0e0b74041048e6a742ee9441a4f3f2, group_id=645dcac893284e2eb9e3f77cb1da4fc8, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:35.695484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd553217-dd1d-4146-91ea-780068ff1071 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:35.724631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 145/296] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 11 11:46:35 2022] PUT /identity/v3/projects/be0e0b74041048e6a742ee9441a4f3f2/groups/645dcac893284e2eb9e3f77cb1da4fc8/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:36.168273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4e50-23f9-42e0-8333-f08adea29e6a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:36.170082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4e50-23f9-42e0-8333-f08adea29e6a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:36.171008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4e50-23f9-42e0-8333-f08adea29e6a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:36.173956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 152/297] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:36.183495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988ca7-354a-468b-988b-80913687a98a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:36.184584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988ca7-354a-468b-988b-80913687a98a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:36.185339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988ca7-354a-468b-988b-80913687a98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:36.227034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-18988ca7-354a-468b-988b-80913687a98a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:36.229561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-18988ca7-354a-468b-988b-80913687a98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:36.390311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 146/298] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:37.013785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d4e50-23f9-42e0-8333-f08adea29e6a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:37.230152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d4e50-23f9-42e0-8333-f08adea29e6a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:37.264098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:37.280144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:37.281328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:37.282722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:37.283054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:37.301830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:37.307412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:37.309082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:37.310723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 153/299] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:37.319781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18988ca7-354a-468b-988b-80913687a98a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:37.443310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:37.493816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18988ca7-354a-468b-988b-80913687a98a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:37.553333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dec283-04d1-4810-91a5-dfa994104a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:37.553918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec283-04d1-4810-91a5-dfa994104a03 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:37.554237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec283-04d1-4810-91a5-dfa994104a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:37.554507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec283-04d1-4810-91a5-dfa994104a03 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:37.555226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dec283-04d1-4810-91a5-dfa994104a03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:37.555528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dec283-04d1-4810-91a5-dfa994104a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:37.556962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dec283-04d1-4810-91a5-dfa994104a03 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:37.571545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 147/300] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:37.577629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:37.745331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b9378-eaa1-4d4a-8bbf-c7101f25f9dd None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:37.791072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:37.791741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:37.792020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:37.792349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:37.816319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e023-6193-4fb9-9ce8-071453af782b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:37.816558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e023-6193-4fb9-9ce8-071453af782b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:37.816887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075e023-6193-4fb9-9ce8-071453af782b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:37.818491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 148/301] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:37.826372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c04e7-1f88-404f-9530-2f63aeb73ec9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:37.826714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c04e7-1f88-404f-9530-2f63aeb73ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:37.827024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c04e7-1f88-404f-9530-2f63aeb73ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:37.859725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-846c04e7-1f88-404f-9530-2f63aeb73ec9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:37.860995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-846c04e7-1f88-404f-9530-2f63aeb73ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:37.958548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:38.003016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:38.004251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:38.060671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 149/302] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:38.222203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 154/303] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:38.230671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c04e7-1f88-404f-9530-2f63aeb73ec9 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:38.323033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:38.370519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c04e7-1f88-404f-9530-2f63aeb73ec9 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:38.413212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:38.413871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:38.414147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:38.414410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:38.415668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:38.417270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:38.419579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 150/304] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:38 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:38.425818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:38.495979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:38.631550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:38.687276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256f8b0-671f-4735-9fd3-cc451bfc9988 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:38.771712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306f0e-fa62-456b-80c9-1f4161fe4843 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:38.804594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:38.805382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:38.805721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:38.806054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:38.813435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:38.813435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:38.814903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 155/305] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Oct 11 11:46:38 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:38.821732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:38.838848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:38.855829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:38.857066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:38.858439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:38.859110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:38.885558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:38.892447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:38.893431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:38.894210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:38.900846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 151/306] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:46:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:38.921190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:39.090987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cc495-928b-4a6d-9199-1425c421c20e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:39.169397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abc36a-e96c-4d08-a7d0-49d52eb1a970 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:39.175570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904dda0-dbdb-4b5f-a204-ece981a4b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:39.177016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904dda0-dbdb-4b5f-a204-ece981a4b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:39.177780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904dda0-dbdb-4b5f-a204-ece981a4b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:39.179498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904dda0-dbdb-4b5f-a204-ece981a4b6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:39.181296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904dda0-dbdb-4b5f-a204-ece981a4b6a3 None admin] RBAC: Adding query filter params (group.id=29cf752f69d349edb698f58014326d7b, role.id=4b08dbe46a7c4b618462666ee2e4b395, scope.project.id=9db0c2d2975949bdb6306acd527d555a) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:39.182125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904dda0-dbdb-4b5f-a204-ece981a4b6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:39.187194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904dda0-dbdb-4b5f-a204-ece981a4b6a3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:39.202196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 156/307] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Oct 11 11:46:38 2022] GET /identity/v3/role_assignments?group.id=29cf752f69d349edb698f58014326d7b&scope.project.id=9db0c2d2975949bdb6306acd527d555a&role.id=4b08dbe46a7c4b618462666ee2e4b395 => generated 611 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:39.205313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c1865-1a8e-4ff8-941c-10f4139a5b10 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:39.206204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c1865-1a8e-4ff8-941c-10f4139a5b10 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:39.206933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c1865-1a8e-4ff8-941c-10f4139a5b10 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:39.210682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 157/308] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:39.219212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d8c1-0e52-4815-a75d-e16eb1e6b5da None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:39.220111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d8c1-0e52-4815-a75d-e16eb1e6b5da None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:39.221005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d8c1-0e52-4815-a75d-e16eb1e6b5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:39.235808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:39.236085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:39.236430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:39.236693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:39.237549 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:39.237848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:39.239751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:39.256409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 152/309] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:39.260014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1f33d8c1-0e52-4815-a75d-e16eb1e6b5da None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:39.262409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:39.263081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1f33d8c1-0e52-4815-a75d-e16eb1e6b5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:39.294404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:39.356355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:39.420869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb8ab-bc31-4204-b5bd-1d52e10c6192 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:39.423745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 158/310] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:39.469737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:39.470393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:39.470781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:39.471048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:39.563192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:39.564724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:39.633673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:39.699429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 153/311] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:39.705550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d8c1-0e52-4815-a75d-e16eb1e6b5da None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:39.906696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d8c1-0e52-4815-a75d-e16eb1e6b5da None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:39.985575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:39.986979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:39.987613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:39.988248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] PATH_INFO: `/v3/projects/9db0c2d2975949bdb6306acd527d555a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:39.990548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] RBAC: Authorizing `identity:get_project(project_id=9db0c2d2975949bdb6306acd527d555a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:39.993527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:39.996980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 159/312] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:39 2022] GET /identity/v3/projects/9db0c2d2975949bdb6306acd527d555a => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:40.006173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:40.154637 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:40.207510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:40.300227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0234d-0cb6-4462-bc76-7c9d67342633 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:40.372739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3d808-00b7-46ba-8cef-e3a232c2eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:40.375093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d808-00b7-46ba-8cef-e3a232c2eded None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.375903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d808-00b7-46ba-8cef-e3a232c2eded None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.376573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3d808-00b7-46ba-8cef-e3a232c2eded None admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.378829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3d808-00b7-46ba-8cef-e3a232c2eded None admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:40.381690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3d808-00b7-46ba-8cef-e3a232c2eded None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:40.384965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 154/313] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Oct 11 11:46:40 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:40.394588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71d0e-7e4a-4ead-ab75-98ffb4853bd7 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.394588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71d0e-7e4a-4ead-ab75-98ffb4853bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.394588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e71d0e-7e4a-4ead-ab75-98ffb4853bd7 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.394588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 155/314] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:40.398893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e71d0e-7e4a-4ead-ab75-98ffb4853bd7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:40.417340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469eda00-cd00-498a-b697-59efaf18eba7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:40.448197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:40.473169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229c0df-bed4-4e97-803a-9ad288248545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:40.473711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c0df-bed4-4e97-803a-9ad288248545 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.474211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c0df-bed4-4e97-803a-9ad288248545 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.474482 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229c0df-bed4-4e97-803a-9ad288248545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.494140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229c0df-bed4-4e97-803a-9ad288248545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-1229c0df-bed4-4e97-803a-9ad288248545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:40.499709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:40.501439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 160/315] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:40.503041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d6f13-b184-4396-b1b0-b449c7350b08 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.504405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d6f13-b184-4396-b1b0-b449c7350b08 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.504405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d6f13-b184-4396-b1b0-b449c7350b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.539010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9f2d6f13-b184-4396-b1b0-b449c7350b08 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:40.541670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9f2d6f13-b184-4396-b1b0-b449c7350b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:40.588471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e71d0e-7e4a-4ead-ab75-98ffb4853bd7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:40.639585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:40.640490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.640946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.641431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.642780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] RBAC: Adding query filter params (group.id=29cf752f69d349edb698f58014326d7b, role.id=ba129f3d0c7c49f08f7334bbc914a775, scope.project.id=9db0c2d2975949bdb6306acd527d555a) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:40.643242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:40.645233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:40.654785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 156/316] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Oct 11 11:46:40 2022] GET /identity/v3/role_assignments?group.id=29cf752f69d349edb698f58014326d7b&scope.project.id=9db0c2d2975949bdb6306acd527d555a&role.id=ba129f3d0c7c49f08f7334bbc914a775 => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:40.656288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:40.682983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 161/317] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:40.685329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05996cd-585b-4047-af30-4ff42e231eab None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.685815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05996cd-585b-4047-af30-4ff42e231eab None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.687401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05996cd-585b-4047-af30-4ff42e231eab None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.688890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 162/318] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:40.698372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cf259-0187-49b0-aaba-e77b582974b3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.699111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cf259-0187-49b0-aaba-e77b582974b3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.700198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cf259-0187-49b0-aaba-e77b582974b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.734996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:40.743840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-890cf259-0187-49b0-aaba-e77b582974b3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:40.745933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-890cf259-0187-49b0-aaba-e77b582974b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:40.793601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:40.817617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1b393-e945-4037-a106-efcbb4cc0909 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:40.872429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:40.873801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:40.874523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:40.875329 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:40.877066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:40.878023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:40.881513 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:40.891753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 163/319] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:40.901597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 157/320] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:40.909158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cf259-0187-49b0-aaba-e77b582974b3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.038726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cf259-0187-49b0-aaba-e77b582974b3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.097227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:41.097866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:41.098143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:41.098410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:41.104105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:41.168637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.220286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:41.222245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:41.320589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f356-9776-4ca3-8c6f-68113b66b1fb None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.364757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:41.365428 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:41.365707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:41.365973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:41.382120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:41.389008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:41.390798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 158/321] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:46:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:41.392230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.404909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:41.414616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 164/322] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 11:46:41.416008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.472442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:41.558481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50f3a-3603-4a47-8c8b-e9a20f126473 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.578912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb9447-c2f4-4232-ab60-cf073b754456 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.599460 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:41.600110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:41.600394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:41.600655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:41.612768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:41.617715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:41.618219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:41.620044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:46:41.621514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:41.622461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:41.622461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:41.622461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:41.631152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 159/323] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:41.631245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:41.631245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:41.631410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.631490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:41.634601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 165/324] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:41.634601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.696625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:41.741718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954f88a-775c-4b6b-a7a3-7e3ee24ff062 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.752135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:41.758541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac79d1-8714-40fb-a767-43b433e92f5a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.794393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:41.795343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:41.795780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:41.796212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:41.798050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:41.800504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:41.803289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 160/325] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:41 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:41.805646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.817656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:41.818285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:41.818611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:41.818852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:41.819556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:41.819855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:41.821284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:41.830636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 166/326] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:41.834958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:41.927505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c228c-a2f8-43c5-b859-057d0aca03ed None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.969591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d007d5-3278-4c81-a728-d0d25a7b76c1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:41.970005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:41.970963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:41.971561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:41.971964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:41.975381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.011716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.012415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.012845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.013288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.015194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.017776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.020830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 167/327] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Oct 11 11:46:41 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:42.021606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.047962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.049915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.058172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.150862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a09b8-ebd5-40ad-a070-5f7f7c4635f2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.161091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 161/328] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:42.161950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.192235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.192820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.193180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.193548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.201052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.267876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.269463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.298295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.304360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434e12-1496-4363-ad2e-c3e9ea69e6c3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.360030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.360937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.361301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.361759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.363019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] RBAC: Adding query filter params (group.id=29cf752f69d349edb698f58014326d7b, role.id=4b08dbe46a7c4b618462666ee2e4b395, scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:42.363504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.365932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.375706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 162/329] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/role_assignments?group.id=29cf752f69d349edb698f58014326d7b&scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb&role.id=4b08dbe46a7c4b618462666ee2e4b395 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:42.376569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.423050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 168/330] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:46:42.424629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.517010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.522408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8727-eb5c-479e-aed5-90c88ac5c252 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.561101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7b5eb-ab74-4dac-9d1c-d6cc5522a47e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.564100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.565039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.565473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.565916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] PATH_INFO: `/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.567237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] RBAC: Authorizing `identity:get_project(project_id=eb55422b2fa54e5baef36f84f4fa45fb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.568798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.570543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 163/331] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/projects/eb55422b2fa54e5baef36f84f4fa45fb => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:42.576574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.608896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.618603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.620328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.620328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.620328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] PATH_INFO: `/v3/projects/be0e0b74041048e6a742ee9441a4f3f2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.620976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] RBAC: Authorizing `identity:get_project(project_id=be0e0b74041048e6a742ee9441a4f3f2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.622435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.625163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 169/332] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/projects/be0e0b74041048e6a742ee9441a4f3f2 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:42.630883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.717834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553beb1-f98b-40f1-9318-cf50910e70a3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.765828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.766327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.766637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.766905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] PATH_INFO: `/v3/groups/29cf752f69d349edb698f58014326d7b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.768059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] RBAC: Authorizing `identity:get_group(group_id=29cf752f69d349edb698f58014326d7b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.768522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19030-d66c-491a-a37c-218d4ba49d84 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.770067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.772282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 164/333] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/groups/29cf752f69d349edb698f58014326d7b => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:42.781082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.821950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.823158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.823158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.823158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] PATH_INFO: `/v3/groups/645dcac893284e2eb9e3f77cb1da4fc8` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.824449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] RBAC: Authorizing `identity:get_group(group_id=645dcac893284e2eb9e3f77cb1da4fc8)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.827178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:42.828594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 170/334] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/groups/645dcac893284e2eb9e3f77cb1da4fc8 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:42.834992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:42.846209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.915467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:42.950465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3e835-b672-431a-a5b2-b557f314167b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.962812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddf261-65b6-4044-8997-ee316cd06b62 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:42.992316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d5851-5aa5-4ff6-9853-c62538fe388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:42.993135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5851-5aa5-4ff6-9853-c62538fe388e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:42.993607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5851-5aa5-4ff6-9853-c62538fe388e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:42.994070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d5851-5aa5-4ff6-9853-c62538fe388e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:42.995584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d5851-5aa5-4ff6-9853-c62538fe388e None admin] RBAC: Adding query filter params (group.id=29cf752f69d349edb698f58014326d7b, role.id=ba129f3d0c7c49f08f7334bbc914a775, scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:42.996134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d5851-5aa5-4ff6-9853-c62538fe388e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:42.998925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d5851-5aa5-4ff6-9853-c62538fe388e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:43.007317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 165/335] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/role_assignments?group.id=29cf752f69d349edb698f58014326d7b&scope.project.id=eb55422b2fa54e5baef36f84f4fa45fb&role.id=ba129f3d0c7c49f08f7334bbc914a775 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:43.010699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e38d0a-e6c6-4e90-8120-c3d8cd057330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:43.011370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38d0a-e6c6-4e90-8120-c3d8cd057330 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:43.011636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38d0a-e6c6-4e90-8120-c3d8cd057330 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:43.011895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38d0a-e6c6-4e90-8120-c3d8cd057330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:43.012651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e38d0a-e6c6-4e90-8120-c3d8cd057330 None admin] RBAC: Adding query filter params (group.id=645dcac893284e2eb9e3f77cb1da4fc8, role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=be0e0b74041048e6a742ee9441a4f3f2) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:43.012970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e38d0a-e6c6-4e90-8120-c3d8cd057330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:43.014445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e38d0a-e6c6-4e90-8120-c3d8cd057330 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:43.021398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 171/336] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Oct 11 11:46:42 2022] GET /identity/v3/role_assignments?group.id=645dcac893284e2eb9e3f77cb1da4fc8&scope.project.id=be0e0b74041048e6a742ee9441a4f3f2&role.id=d32b6669146241ab9d1fda575c016787 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:46.073016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcd668-1a57-49ab-a18a-13399c948d3e None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:46.073858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcd668-1a57-49ab-a18a-13399c948d3e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:46.073858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dcd668-1a57-49ab-a18a-13399c948d3e None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:46.075019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 166/337] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:46.090045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345289e7-0033-49c6-b3d3-7d779c81093b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:46.091002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345289e7-0033-49c6-b3d3-7d779c81093b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:46.091437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345289e7-0033-49c6-b3d3-7d779c81093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:46.122380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-345289e7-0033-49c6-b3d3-7d779c81093b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:46.124350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-345289e7-0033-49c6-b3d3-7d779c81093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:46.225241 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 172/338] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:46.461197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b574ff-8957-4f7b-8923-2b96247aacc1 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:46.461197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b574ff-8957-4f7b-8923-2b96247aacc1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:46.461197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b574ff-8957-4f7b-8923-2b96247aacc1 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:46.461197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 167/339] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:46.467420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee9b24-31a7-4c11-9ee6-057ca6baf47e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:46.468025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee9b24-31a7-4c11-9ee6-057ca6baf47e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:46.468486 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee9b24-31a7-4c11-9ee6-057ca6baf47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:46.495658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-60ee9b24-31a7-4c11-9ee6-057ca6baf47e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:46.497221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-60ee9b24-31a7-4c11-9ee6-057ca6baf47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:46.568974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:46.589251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 173/340] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:46.658137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b574ff-8957-4f7b-8923-2b96247aacc1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:46.797915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:46.803572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b574ff-8957-4f7b-8923-2b96247aacc1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:46.843222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:46.843871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:46.844157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:46.844392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:46.856403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:46.857969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:46.878070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:46.880547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:46.882237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:46.882237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:46.882237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:46.882237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 168/341] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:46.888045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee9b24-31a7-4c11-9ee6-057ca6baf47e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:46.929600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:47.067849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366be3-e55c-4c07-b416-b760a65c41f0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:47.124478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:47.125482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.125482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.125742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.154076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:47.155652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:47.177048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee9b24-31a7-4c11-9ee6-057ca6baf47e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:47.194575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:47.196254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:47.197885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:47.197885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:47.197885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:47.197885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 169/342] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:47.207918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:47.211464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:47.242786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:47.243420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.243697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.243966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.244633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:47.244932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:47.246386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:47.260096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 174/343] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:47.265761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:47.320762 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:47.380155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a590-c1ce-484a-8e57-474a50146cc2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:47.417740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:47.418754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.419031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.419299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.419974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:47.421642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:47.447792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 175/344] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:47 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:46:47.510459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa08d78-5088-40dd-888c-1aae4a36f29d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:47.564010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62169330-f181-4a01-b747-f6414ecafcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:47.564674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169330-f181-4a01-b747-f6414ecafcbe None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.564957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169330-f181-4a01-b747-f6414ecafcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.565227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169330-f181-4a01-b747-f6414ecafcbe None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.565917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62169330-f181-4a01-b747-f6414ecafcbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:47.566218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62169330-f181-4a01-b747-f6414ecafcbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:47.567751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62169330-f181-4a01-b747-f6414ecafcbe None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:47.597581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 170/345] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:47.604139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:47.670379 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab04c2-84ad-4a27-87f1-8608d7b570f5 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.670728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab04c2-84ad-4a27-87f1-8608d7b570f5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.671023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab04c2-84ad-4a27-87f1-8608d7b570f5 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.672736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 171/346] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:47.678683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdde25-d603-492c-968a-205cca126861 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.679006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdde25-d603-492c-968a-205cca126861 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.679224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdde25-d603-492c-968a-205cca126861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.700532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7ecdde25-d603-492c-968a-205cca126861 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:47.701815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7ecdde25-d603-492c-968a-205cca126861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:47.814482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:47.829247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 172/347] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:47.859570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f339b1-9c47-4df1-bef2-14f90b2dcfd5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:47.864001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:47.880787 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961060-fe10-447d-8582-82881708ee54 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.881136 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961060-fe10-447d-8582-82881708ee54 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.881336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef961060-fe10-447d-8582-82881708ee54 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.884253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 173/348] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:47.890452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a931dd-50a8-4b69-a46a-26ad8f2f0696 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.890821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a931dd-50a8-4b69-a46a-26ad8f2f0696 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.891094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a931dd-50a8-4b69-a46a-26ad8f2f0696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.912500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-05a931dd-50a8-4b69-a46a-26ad8f2f0696 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:47.913742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-05a931dd-50a8-4b69-a46a-26ad8f2f0696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:47.924444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63f8e4-4924-46f2-9e92-de9d560aa8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:47.925074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8e4-4924-46f2-9e92-de9d560aa8a4 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:47.925350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8e4-4924-46f2-9e92-de9d560aa8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:47.925619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f8e4-4924-46f2-9e92-de9d560aa8a4 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:47.926285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63f8e4-4924-46f2-9e92-de9d560aa8a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:47.927833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63f8e4-4924-46f2-9e92-de9d560aa8a4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:47.958517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 176/349] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:47 2022] POST /identity/v3/users => generated 248 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:46:48.054654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 174/350] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:48.203921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41afe3e-88a4-4f4f-b596-04256822d640 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:48.204611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41afe3e-88a4-4f4f-b596-04256822d640 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:48.204611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41afe3e-88a4-4f4f-b596-04256822d640 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:48.205826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 177/351] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:48.211721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd198f8-a99a-42d5-a36e-497417e86e84 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:48.212906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd198f8-a99a-42d5-a36e-497417e86e84 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:48.213382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd198f8-a99a-42d5-a36e-497417e86e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:48.233688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1cd198f8-a99a-42d5-a36e-497417e86e84 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:48.235322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1cd198f8-a99a-42d5-a36e-497417e86e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:48.247841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41afe3e-88a4-4f4f-b596-04256822d640 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:48.346808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 175/352] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:48.458532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41afe3e-88a4-4f4f-b596-04256822d640 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:48.491955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd198f8-a99a-42d5-a36e-497417e86e84 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:48.541484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:48.543218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:48.543698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:48.544154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:48.577369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:48.587222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:48.641460 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:48.646537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:48.648653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:48.650643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:48.650643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:48.650643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:48.650643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 178/353] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:48.651454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:48.689228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:48.723866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd198f8-a99a-42d5-a36e-497417e86e84 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:48.765380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:48.766091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:48.766358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:48.766663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:48.778392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:48.779976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:48.798604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:48.800327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:48.801945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:48.801945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:48.801945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:48.804904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 176/354] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:48.805893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:48.891930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d57d0-a044-4eec-8c58-4f33529aaaeb None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:48.939272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:48.939871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:48.940139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:48.940396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:48.941073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:48.943330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:48.954438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.sql.core [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 11:46:48.954438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 11 11:46:48.954438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [parameters: {'id': '64c798864ee14f5988873cb18d079333', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 11 11:46:48.954438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 11:46:48.964934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c5e02-85cf-4190-86c1-0aaf3b6c3406 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 11 11:46:48.967699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return ref.to_dict() Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:46:48.968602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application yield resource Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise self.value Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application session.commit() Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 11:46:48.969485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.flush() Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application compat.raise_( Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 11:46:48.971109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:46:48.973389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:46:48.978531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [parameters: {'id': '64c798864ee14f5988873cb18d079333', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:48.981944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 11 11:46:48.983882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:48.985826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 179/355] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Oct 11 11:46:48 2022] POST /identity/v3/roles => generated 144 bytes in 319 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:48.985826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:48.989291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:49.027389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:49.028958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:49.029449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:49.029954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:49.031187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:49.031702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:49.033905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:49.050876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 177/356] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:49.052815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:49.073135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:49.107019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3381d24-97bc-404a-a85f-a19dae9ab08d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:49.150513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:49.151163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:49.151528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:49.151900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:49.152571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:49.152912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:49.154310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:49.174070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 180/357] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:49.174070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:49.220082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6cdcf-ead9-43e8-93c5-b60bde3348f2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:49.273735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:49.274983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:49.275624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:49.276038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:49.292317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:49.299505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:49.300874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 11 11:46:49.302632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:49.306402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 178/358] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:46:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:49.309468 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:49.346629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b7df-78b5-4e20-a655-1b82f08357b1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:49.367007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:49.424935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:49.426221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:49.426922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:49.427592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:49.429048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:49.431849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:49.449922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:49.480018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 181/359] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:49 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:46:49.481817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:49.524414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7e54c-7493-4ce9-b7e1-01e6364f42af None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:49.590482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389e2a9-6308-4894-a3d6-881f642892bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:49.591918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e2a9-6308-4894-a3d6-881f642892bf None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:49.592085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e2a9-6308-4894-a3d6-881f642892bf None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:49.592426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389e2a9-6308-4894-a3d6-881f642892bf None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:49.593667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389e2a9-6308-4894-a3d6-881f642892bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:49.596435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389e2a9-6308-4894-a3d6-881f642892bf None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:49.624491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517283bc-f4aa-4c90-a53c-dd13a7d37096 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:49.650642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 179/360] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:49 2022] POST /identity/v3/users => generated 249 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:46:49.673213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d669855-b8bb-4e92-925a-fe1c51cc9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:49.674137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d669855-b8bb-4e92-925a-fe1c51cc9903 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:49.674699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d669855-b8bb-4e92-925a-fe1c51cc9903 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:49.675117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d669855-b8bb-4e92-925a-fe1c51cc9903 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:49.676113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d669855-b8bb-4e92-925a-fe1c51cc9903 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:49.676613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d669855-b8bb-4e92-925a-fe1c51cc9903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:49.678196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d669855-b8bb-4e92-925a-fe1c51cc9903 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:49.689298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 182/361] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:50.368781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee002-6972-44d5-9446-5da18818a994 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:50.369648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee002-6972-44d5-9446-5da18818a994 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:50.369648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eee002-6972-44d5-9446-5da18818a994 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:50.371081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 180/362] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:50.377885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706f3be-9ee0-469a-b2ba-e5e50fb214af None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:50.379455 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706f3be-9ee0-469a-b2ba-e5e50fb214af None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:50.380218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706f3be-9ee0-469a-b2ba-e5e50fb214af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:50.424613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d706f3be-9ee0-469a-b2ba-e5e50fb214af None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:50.427089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d706f3be-9ee0-469a-b2ba-e5e50fb214af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:50.550940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:50.598631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 183/363] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 11 11:46:51.067024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eee002-6972-44d5-9446-5da18818a994 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:51.189261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:51.217300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eee002-6972-44d5-9446-5da18818a994 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:51.268195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:51.268739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:51.269065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:51.269332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:51.282094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:51.287149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:51.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:51.290904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 181/364] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:46:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:46:51.295775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706f3be-9ee0-469a-b2ba-e5e50fb214af None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:51.547537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706f3be-9ee0-469a-b2ba-e5e50fb214af None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:51.627951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fb0a5-ef5c-44d2-83b5-b082150176ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:51.628974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb0a5-ef5c-44d2-83b5-b082150176ce None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:51.629448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb0a5-ef5c-44d2-83b5-b082150176ce None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:51.629908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb0a5-ef5c-44d2-83b5-b082150176ce None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:51.631116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fb0a5-ef5c-44d2-83b5-b082150176ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:51.631651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fb0a5-ef5c-44d2-83b5-b082150176ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:51.634207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fb0a5-ef5c-44d2-83b5-b082150176ce None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:51.654871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 184/365] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:46:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:46:51.661226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:51.826823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8447615-aab0-48be-ac65-c3264900b513 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:51.872916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:51.873566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:51.873876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:51.874143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:51.886778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:51.887170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160456-76d8-4183-a177-2be0049ebca6 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:51.887657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160456-76d8-4183-a177-2be0049ebca6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:51.888120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160456-76d8-4183-a177-2be0049ebca6 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:51.889320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:51.891002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:51.892741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 185/366] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:46:51.901593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ec5a-d2e7-40d8-941c-dd4754b3f3b0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:51.902058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ec5a-d2e7-40d8-941c-dd4754b3f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:51.902511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ec5a-d2e7-40d8-941c-dd4754b3f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:51.912390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:51.913878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:51.915832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:51.915832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:51.915832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:51.915832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 182/367] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:51.920376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:51.952572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8357ec5a-d2e7-40d8-941c-dd4754b3f3b0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:51.959681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8357ec5a-d2e7-40d8-941c-dd4754b3f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:52.109724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:52.165126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 186/368] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:46:52.192893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42b94-48e8-483e-90eb-23f86f7cc355 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:52.251437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:52.252082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:52.252358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:52.252636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:52.253285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:52.253585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:52.255038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:52.277907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 183/369] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:52.283600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ec5a-d2e7-40d8-941c-dd4754b3f3b0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:52.397886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ec5a-d2e7-40d8-941c-dd4754b3f3b0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:52.451727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:52.452401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:52.452676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:52.452968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:52.470625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:52.470625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:46:52.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:52.495357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:46:52.497251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:52.503550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 187/370] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Oct 11 11:46:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:52.515828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:52.660082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:52.772119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fa163-7b58-47db-ae25-6421ea605904 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:52.849199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:52.849841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:52.850183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:52.850456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:52.851377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:52.851673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:52.853453 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:52.863441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:52.955225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:52.986877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 184/371] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 11 11:46:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:52.992890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:53.262100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11e166-0689-4342-aa92-3c779f68fa2e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:53.375664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf839e2-cbc2-4bdf-ab39-e3628a0281f2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:53.383905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b800fb-fc89-4758-9918-130c6bb0c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:53.384968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b800fb-fc89-4758-9918-130c6bb0c314 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.385448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b800fb-fc89-4758-9918-130c6bb0c314 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.385989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b800fb-fc89-4758-9918-130c6bb0c314 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.390143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:53.407105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b800fb-fc89-4758-9918-130c6bb0c314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d1b800fb-fc89-4758-9918-130c6bb0c314 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:53.413766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:53.415551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 188/372] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:46:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 552 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:53.417234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e88f6-8b74-4fb1-aab2-8b2a6f1de92f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.419073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e88f6-8b74-4fb1-aab2-8b2a6f1de92f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.419073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e88f6-8b74-4fb1-aab2-8b2a6f1de92f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.430591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 189/373] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:53.430591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9785ed-6905-424f-ae7b-550cea9bc51f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.430591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9785ed-6905-424f-ae7b-550cea9bc51f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.430591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9785ed-6905-424f-ae7b-550cea9bc51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.432461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:53.433526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.433967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.434413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.447465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2c9785ed-6905-424f-ae7b-550cea9bc51f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:53.449672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2c9785ed-6905-424f-ae7b-550cea9bc51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:53.452405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:53.455287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:53.486001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:53.487268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:53.488088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:53.488088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:53.488088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:53.488595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 185/374] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:53.489904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:53.538888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 190/375] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:53.538888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c902-5105-43cb-8d0a-5a6090d12eca None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.538888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c902-5105-43cb-8d0a-5a6090d12eca None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.538888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c902-5105-43cb-8d0a-5a6090d12eca None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.538888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 191/376] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:53.538888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c902-5105-43cb-8d0a-5a6090d12eca None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:53.576834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:53.641326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18066c1f-ffe3-48a7-a2dc-d98bfcea82de None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:53.692615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65adc07-fa72-4c01-9b32-43606d821a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:53.693514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65adc07-fa72-4c01-9b32-43606d821a3a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.693923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65adc07-fa72-4c01-9b32-43606d821a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.694667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65adc07-fa72-4c01-9b32-43606d821a3a None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.695562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65adc07-fa72-4c01-9b32-43606d821a3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:53.696517 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65adc07-fa72-4c01-9b32-43606d821a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:53.698206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65adc07-fa72-4c01-9b32-43606d821a3a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:53.718354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 186/377] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:46:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:53.718354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec074398-252f-4e44-8891-c0a7be156114 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.718666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec074398-252f-4e44-8891-c0a7be156114 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.719401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec074398-252f-4e44-8891-c0a7be156114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.734839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c902-5105-43cb-8d0a-5a6090d12eca None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:53.745174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ec074398-252f-4e44-8891-c0a7be156114 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:53.746779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ec074398-252f-4e44-8891-c0a7be156114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:53.770823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:53.802680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:53.803863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:53.804340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:53.804793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:53.806004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:53.806523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:53.809190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:53.833398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 192/378] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:53.835136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:53.835974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 187/379] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:53.847421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec074398-252f-4e44-8891-c0a7be156114 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:53.990597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:54.011617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec074398-252f-4e44-8891-c0a7be156114 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.020827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfacbd-52ca-4058-8d8d-44bd02e9e399 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.072231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.073248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.073693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.074128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.084750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2fbea-1722-4139-aac0-5ed7b5214d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.086266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2fbea-1722-4139-aac0-5ed7b5214d17 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.087066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2fbea-1722-4139-aac0-5ed7b5214d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.087505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2fbea-1722-4139-aac0-5ed7b5214d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.092195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:54.101745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:54.103589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:54.106053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 188/380] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:46:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:54.108954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2fbea-1722-4139-aac0-5ed7b5214d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:54.109608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.109837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2fbea-1722-4139-aac0-5ed7b5214d17 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:54.131448 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-46a2fbea-1722-4139-aac0-5ed7b5214d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:54.131938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:54.133122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:54.134704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:54.134704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:54.134704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:54.134704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 193/381] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:54.137494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a0a54-70ac-48a5-a619-0445dd05b5b2 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.137494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a0a54-70ac-48a5-a619-0445dd05b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.137494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a0a54-70ac-48a5-a619-0445dd05b5b2 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.139973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 194/382] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:54.141281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a0a54-70ac-48a5-a619-0445dd05b5b2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.232708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4563a-2994-4d0d-a5ae-90751e7d8559 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.268913 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.269555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.269823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.270082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.277264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a0a54-70ac-48a5-a619-0445dd05b5b2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.278019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:54.279589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:46:54.293344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:54.294455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:54.295322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 189/383] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:54.295788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.336004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.336566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.336900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.337180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.337953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:54.338256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:54.339792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:54.345548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:54.356707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 195/384] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:54.356707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.395079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:54.423037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380be6-9c97-496a-a496-56f96a139cf2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.459238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bcc29-0e30-45b0-952b-bc3dca45da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.459879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bcc29-0e30-45b0-952b-bc3dca45da85 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.460145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bcc29-0e30-45b0-952b-bc3dca45da85 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.460405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bcc29-0e30-45b0-952b-bc3dca45da85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.471076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bcc29-0e30-45b0-952b-bc3dca45da85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:54.471398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108197f-f1a5-47e3-8ef5-b86015a9b441 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-672bcc29-0e30-45b0-952b-bc3dca45da85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:54.476417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:54.477487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:54.478276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 190/385] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:54.479241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c103b48-1995-48e0-81cd-3e771a4cc3f8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.479333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c103b48-1995-48e0-81cd-3e771a4cc3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.479581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c103b48-1995-48e0-81cd-3e771a4cc3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.499265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2c103b48-1995-48e0-81cd-3e771a4cc3f8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:54.500480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2c103b48-1995-48e0-81cd-3e771a4cc3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:54.510366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.511154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.511525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.511771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.512792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:54.513130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:54.515673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:54.528934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 196/386] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:54.529882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.584245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 191/387] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:54.585451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c103b48-1995-48e0-81cd-3e771a4cc3f8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.599200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:54.651980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3781af1-abf2-4b93-ba29-817895ff4c0f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.681623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:54.715017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.716364 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.716805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.717210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.718499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:54.719099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:54.721673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:54.744966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c103b48-1995-48e0-81cd-3e771a4cc3f8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.760395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 197/388] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:54.760395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.796723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.797367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.797637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.797902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.817846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:54.821231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:54.838414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:54.844709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:54.845528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:54.845528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:54.845528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:54.845528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 192/389] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:54.845528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.896020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb26768-3628-4709-b69d-603ee71089e7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.917684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:54.938037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:54.939096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:54.939561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:54.940028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:54.941206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:54.941738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:54.944338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:54.956331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 198/390] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:54.957156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:54.963194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435ea4-32fa-49d9-85a5-930a3b0c392a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:54.981138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:55.005865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.006667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.006940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.007202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.016975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.018465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:46:55.033476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:55.034804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 193/391] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:55.036174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.090002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355590-7a84-402f-a34b-477f52abf8b5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.143550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e4cf1-ed17-4f09-b7cc-68a647ce753e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.147911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.149002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.149494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.149866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/c3fb3dc7226c48f1a33c6e73d3ff32a6/roles/e72e1826d36c4a618d9bb4023d8acd93` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.174868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=c3fb3dc7226c48f1a33c6e73d3ff32a6, role_id=e72e1826d36c4a618d9bb4023d8acd93)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.176914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.179188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56685-798a-44be-96af-15688572da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.179813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56685-798a-44be-96af-15688572da3f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.180085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56685-798a-44be-96af-15688572da3f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.180350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c56685-798a-44be-96af-15688572da3f None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.181003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c56685-798a-44be-96af-15688572da3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:55.181302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c56685-798a-44be-96af-15688572da3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.182849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c56685-798a-44be-96af-15688572da3f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.195609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 199/392] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:54 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/c3fb3dc7226c48f1a33c6e73d3ff32a6/roles/e72e1826d36c4a618d9bb4023d8acd93 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:55.196314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.204841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 194/393] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:55.204841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56685-798a-44be-96af-15688572da3f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.249392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:55.269730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:55.359273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d03be6-3047-44cc-9bdc-b584f7418310 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.381783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c56685-798a-44be-96af-15688572da3f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.409440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.410116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.410406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.410707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.423591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.425388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.427684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.428694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.429152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.429624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.441634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:55.441818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:55.442693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:55.443528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:55.443528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:55.443528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:55.443528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 200/394] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:55.443754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.449625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:55.467307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:55.468693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:55.469537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:55.469537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:55.469537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:55.469537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 195/395] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:55.471166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.567272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:55.589481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:55.597356 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed5b53-faa8-46ba-91e6-3ed5ecf9fde6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.604107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c5acc-861d-405e-b7f0-82dda63121d9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.639916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.640540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.640832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.641097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.641835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:55.642146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.643624 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.647427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.648722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.649399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.650060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.665154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.668650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.685156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 201/396] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:55.686041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:46:55.692500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:55.693796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:55.694704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 196/397] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:55.698611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.808420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be65a33-8444-4090-aaf5-ebb60b3451ab None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.827622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa180bb6-646e-4362-94ea-d58e0cb82406 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:55.863681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.864551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.864551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.864822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.865490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:55.865782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.867246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.869867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:55.870500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:55.870805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:55.871077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:55.871743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:55.872043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:55.873449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:55.885018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 197/398] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:55.885018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.900011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:55.901606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 202/399] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:55.903334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:55.906786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:56.032896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3f6fe-2ac3-4b21-9d96-d07cf437bd2f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.046041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbe07-c1c6-4b01-b3ec-1e5e26f51367 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.077068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.077734 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.078008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.078272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.089847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.090946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.105038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.105770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.105967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.106201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.107058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:56.107353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.108860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:56.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:56.111739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:56.112645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:56.112645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:56.112645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:56.112645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 198/400] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:56.113327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.140009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 203/401] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 11 11:46:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:56.141022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.205722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:56.232771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:56.259366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41df76f-a9fc-48e3-8ef1-c4a4d9d8506d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.289728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482f8c3-88ca-48f3-a35e-4f3d272dffad None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.312900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.314032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.314498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.315010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.329987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.332766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.336742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.337377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.337651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.337920 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.338646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.340767 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:46:56.355590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:56.357555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 11:46:56.359282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:56.362470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 199/402] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:46:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:56.363497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.378935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 204/403] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:46:56 2022] POST /identity/v3/users => generated 247 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:46:56.380972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.513033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb613bf-14af-42c9-97cf-4526149481e7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.515564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714df36-78c5-4fef-9e89-43a32475f91e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.543368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:56.546629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:56.569936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.570949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.571516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.571974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.576282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.577173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.577458 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.577842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.578712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:56.579058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.580496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.588273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.590232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.601512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 200/404] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:56.603972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:56.611078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:56.612094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:56.612907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:56.612907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:56.612907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:56.620030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 205/405] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:56.621404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.765238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d7cb3-bde0-4e6a-a77e-ec5caa37a145 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.804069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.804686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.804956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.805257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.805969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:56.806262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.807796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.809958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556754fd-a680-42e9-9ae9-64dad51e9d33 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:56.836218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 201/406] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Oct 11 11:46:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:56.838621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.854297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:56.854927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:56.855870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:56.856142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:56.865376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:56.866827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:46:56.882380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:56.883923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 206/407] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:56.885485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:56.904623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:56.928440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:56.996942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f175b-09a9-4106-b5e3-0b1884fc1c51 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.034769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b131b0d-c818-42d9-bddf-193aed097561 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.062704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.063347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.063617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.063876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.064543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:57.064839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.066473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.090495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.092562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.093147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.093929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.098042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 202/408] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:57.099661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:57.108804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.111178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:57.128288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:57.129243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:57.130066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:57.130066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:57.130066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:57.138369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 207/409] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:57.138369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:57.268081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:57.273581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62a48c-25cb-46d3-84a8-f00e6d6d80c8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.302470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:57.342408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.343814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.344414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.345014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.345267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d38a5-afc1-4a22-91fb-dc3f766f694b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.346627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:57.347388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.350857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.391764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 203/410] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:57.393829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:57.413640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.414759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.415363 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.416724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.430147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.433347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:46:57.457203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:57.458096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:57.458968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:57.466513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 208/411] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:57.467972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:57.575117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f154aa-e685-456e-a56b-c44cb1d66f39 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.617019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af196d-d11b-439e-b3a4-b5a3a5282961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.617964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af196d-d11b-439e-b3a4-b5a3a5282961 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.618514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af196d-d11b-439e-b3a4-b5a3a5282961 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.618980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af196d-d11b-439e-b3a4-b5a3a5282961 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.619859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af196d-d11b-439e-b3a4-b5a3a5282961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:57.620331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af196d-d11b-439e-b3a4-b5a3a5282961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.622006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af196d-d11b-439e-b3a4-b5a3a5282961 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.627915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4747c-ce5b-4fb5-8d91-be26fdbc3867 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.639397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 204/412] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:57.641828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773dd4-3899-4a03-8006-d95be3053349 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.642355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773dd4-3899-4a03-8006-d95be3053349 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.642773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773dd4-3899-4a03-8006-d95be3053349 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.650131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 205/413] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:57.650131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773dd4-3899-4a03-8006-d95be3053349 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:57.677614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:57.698729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.699893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.700383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.700864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/b78db6f3cf17421898e1597c65998fad/roles/e72e1826d36c4a618d9bb4023d8acd93` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.720483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:57.728297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=b78db6f3cf17421898e1597c65998fad, role_id=e72e1826d36c4a618d9bb4023d8acd93)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.730877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.751972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 209/414] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:57 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/b78db6f3cf17421898e1597c65998fad/roles/e72e1826d36c4a618d9bb4023d8acd93 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:57.753297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:57.842436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773dd4-3899-4a03-8006-d95be3053349 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.886101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebb87-c1c9-440e-ae3a-733034ed46d5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:57.911789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca21f3b-39ed-4171-bb5f-fb4a99fbeef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.912863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca21f3b-39ed-4171-bb5f-fb4a99fbeef4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.913341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca21f3b-39ed-4171-bb5f-fb4a99fbeef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.913851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca21f3b-39ed-4171-bb5f-fb4a99fbeef4 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.915153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca21f3b-39ed-4171-bb5f-fb4a99fbeef4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:57.915662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca21f3b-39ed-4171-bb5f-fb4a99fbeef4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.919504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca21f3b-39ed-4171-bb5f-fb4a99fbeef4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.930668 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:57.931336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.931607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.931870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.940167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:57.941730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:57.948022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 206/415] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:46:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:57.949533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4c1bd-4f1f-4b61-bfe5-45ba5e24ed50 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:57.949805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4c1bd-4f1f-4b61-bfe5-45ba5e24ed50 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:57.950079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4c1bd-4f1f-4b61-bfe5-45ba5e24ed50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:46:57.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:57.956150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 210/416] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:46:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:57.957818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:57.988095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c0c4c1bd-4f1f-4b61-bfe5-45ba5e24ed50 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:57.988095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c0c4c1bd-4f1f-4b61-bfe5-45ba5e24ed50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:58.042646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:58.120391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37a5b-82d1-46d5-adff-5b5cff6a50ac None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:58.123135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 207/417] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:58.124345 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4c1bd-4f1f-4b61-bfe5-45ba5e24ed50 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:58.145744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:58.204667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:58.205680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:58.206111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:58.206524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/bb63e30c48464c1ebe9305c620291c5d/roles/e72e1826d36c4a618d9bb4023d8acd93` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:58.225163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=bb63e30c48464c1ebe9305c620291c5d, role_id=e72e1826d36c4a618d9bb4023d8acd93)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:58.226928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:58.253753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 211/418] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:57 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/bb63e30c48464c1ebe9305c620291c5d/roles/e72e1826d36c4a618d9bb4023d8acd93 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:58.347776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4c1bd-4f1f-4b61-bfe5-45ba5e24ed50 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:58.400768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:58.401700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:58.402146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:58.402590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:58.403487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:58.403944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:58.405614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:58.421676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 208/419] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:58.430912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:58.555211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:58.559436 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8858ff-a26c-4d13-ada3-0b260df0448d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:58.600984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:58.601677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:58.601951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:58.602218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/985db5d7ded74dbeaa8fae4515fea049/roles/e72e1826d36c4a618d9bb4023d8acd93` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:58.621878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=985db5d7ded74dbeaa8fae4515fea049, role_id=e72e1826d36c4a618d9bb4023d8acd93)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:58.623451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:58.644133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 212/420] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:46:58 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/985db5d7ded74dbeaa8fae4515fea049/roles/e72e1826d36c4a618d9bb4023d8acd93 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:46:58.721888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:58.893820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:58.965453 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c088bf-8c89-4595-892c-dad465930ec1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:59.030287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:59.031592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:59.032065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:59.032539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:59.065327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:46:59.076157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:59.077107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:46:59.077891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:59.079071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 209/421] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:46:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:59.087731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:59.219564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56809ec-bfb8-4902-840e-ac5e2afa6d57 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:59.255790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713924b-5577-44e7-92f5-85ba72dcd0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:59.256326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713924b-5577-44e7-92f5-85ba72dcd0af None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:59.256594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713924b-5577-44e7-92f5-85ba72dcd0af None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:59.256857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713924b-5577-44e7-92f5-85ba72dcd0af None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:59.257523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713924b-5577-44e7-92f5-85ba72dcd0af None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:46:59.257820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713924b-5577-44e7-92f5-85ba72dcd0af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:59.259239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713924b-5577-44e7-92f5-85ba72dcd0af None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:59.268728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 213/422] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:46:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:46:59.277494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:59.504776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2e0d-7af1-444c-b3ad-72a38a4ed14f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:59.505233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2e0d-7af1-444c-b3ad-72a38a4ed14f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:59.505600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be2e0d-7af1-444c-b3ad-72a38a4ed14f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:59.507475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 214/423] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:46:59.520725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67870eb-43e8-4318-b00e-6583bc6439ce None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:59.521140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67870eb-43e8-4318-b00e-6583bc6439ce None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:59.521555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67870eb-43e8-4318-b00e-6583bc6439ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:59.538057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa857-21aa-4f63-bfc9-5519ef53192e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:46:59.551037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b67870eb-43e8-4318-b00e-6583bc6439ce None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:46:59.552263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b67870eb-43e8-4318-b00e-6583bc6439ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:46:59.561106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:59.629861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 215/424] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:46:59.661629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:46:59.662331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:46:59.662652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:46:59.662910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:46:59.667142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:46:59.679789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:46:59.681553 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:46:59.705414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:46:59.707608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:46:59.709524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:46:59.709524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:46:59.709524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:46:59.709524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 210/425] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:46:59.716352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67870eb-43e8-4318-b00e-6583bc6439ce None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:46:59.963330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67870eb-43e8-4318-b00e-6583bc6439ce None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:00.044660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:00.045688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:00.046157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:00.046644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:00.047832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:00.048325 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:00.050979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:00.073665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 216/426] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:00.082541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:00.263846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4967b97-71fe-4610-a791-f11b2e9f19ff None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:00.324598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:00.325507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:00.325950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:00.326227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:00.326861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:00.331169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:00.350586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:00.352112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:00.379541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:00.380478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:00.381351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:00.385212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 211/427] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Oct 11 11:47:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:00.390182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:00.499027 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:00.566736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6befb40-b785-4d46-b83f-3211c98e42f2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:00.650512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:00.651674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:00.652152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:00.652622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:00.668090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781bf3a-6eb9-4754-ab79-ea4bcc472f2e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:00.673958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:00.685323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:00.687057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:00.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:00.699914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 217/428] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:00.701883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:00.771731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:00.773332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:00.774109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:00.774874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:00.776577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:00.777397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:00.780445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:00.823332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:00.833003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 212/429] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 11 11:47:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:00.840847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:00.900519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102da9bb-4710-49bc-8e0d-24328a4219fe None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:00.965726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:00.966693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:00.967149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:00.967628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:00.968840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:00.969372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:00.972275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:00.989684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 218/430] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:47:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:00.998302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:01.128174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:01.144925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676acb18-d169-4fdd-b75e-6da32576352d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:01.190116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053844-1fee-4968-a243-a0ee5ab9993c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:01.235213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:01.254825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:01.256097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:01.256572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:01.257031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:01.267401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57929a7b-2150-4b34-baab-8ff62e4e3942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:01.268058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57929a7b-2150-4b34-baab-8ff62e4e3942 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:01.268335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57929a7b-2150-4b34-baab-8ff62e4e3942 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:01.268610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57929a7b-2150-4b34-baab-8ff62e4e3942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:01.278392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:01.281272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:01.312681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:01.314232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:01.316110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:01.316110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:01.316110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:01.316110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 219/431] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:01.332533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:01.467855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57929a7b-2150-4b34-baab-8ff62e4e3942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:01.469406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57929a7b-2150-4b34-baab-8ff62e4e3942 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:01.553085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4138c-067a-4f80-aa04-fa9eb98a734e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:01.616366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfb131-0e52-43e8-92d6-2e1d3265f06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:01.618031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfb131-0e52-43e8-92d6-2e1d3265f06f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:01.618496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfb131-0e52-43e8-92d6-2e1d3265f06f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:01.618983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfb131-0e52-43e8-92d6-2e1d3265f06f None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:01.620145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfb131-0e52-43e8-92d6-2e1d3265f06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:01.620645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfb131-0e52-43e8-92d6-2e1d3265f06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:01.623466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfb131-0e52-43e8-92d6-2e1d3265f06f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:01.646509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 220/432] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:01.648711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6037a-0ec6-4d35-9f93-3b537571f99d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:01.649169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6037a-0ec6-4d35-9f93-3b537571f99d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:01.649619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6037a-0ec6-4d35-9f93-3b537571f99d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:01.653242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 221/433] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:01.654809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6037a-0ec6-4d35-9f93-3b537571f99d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:01.685739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:01.697246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 213/434] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:47:01.700245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288a57-c5f0-4d9a-bf36-fecf5da6089d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:01.701058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288a57-c5f0-4d9a-bf36-fecf5da6089d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:01.701782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288a57-c5f0-4d9a-bf36-fecf5da6089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:01.728907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:01.743283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a6288a57-c5f0-4d9a-bf36-fecf5da6089d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:01.747975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a6288a57-c5f0-4d9a-bf36-fecf5da6089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:01.867466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6037a-0ec6-4d35-9f93-3b537571f99d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:01.902364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 214/435] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:01.905046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6288a57-c5f0-4d9a-bf36-fecf5da6089d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:01.939914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:01.940899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:01.941426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:01.942008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:01.957523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:01.960305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:01.984584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:01.986263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:01.988659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 222/436] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:01.997518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:02.133099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6288a57-c5f0-4d9a-bf36-fecf5da6089d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:02.149841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:02.156351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4df77-60c9-4340-9854-efa1515382ec None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:02.181177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:02.192296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02544c91-77c4-4767-a800-f9a66b67804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:02.192296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02544c91-77c4-4767-a800-f9a66b67804e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.192296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02544c91-77c4-4767-a800-f9a66b67804e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.192296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02544c91-77c4-4767-a800-f9a66b67804e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.204878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826f281-b2d6-4014-b2fc-489ba74e9229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:02.205517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826f281-b2d6-4014-b2fc-489ba74e9229 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.205870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826f281-b2d6-4014-b2fc-489ba74e9229 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.206087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826f281-b2d6-4014-b2fc-489ba74e9229 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.206649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02544c91-77c4-4767-a800-f9a66b67804e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:02.207053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826f281-b2d6-4014-b2fc-489ba74e9229 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:02.207413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826f281-b2d6-4014-b2fc-489ba74e9229 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:02.208129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02544c91-77c4-4767-a800-f9a66b67804e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:02.208839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826f281-b2d6-4014-b2fc-489ba74e9229 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-02544c91-77c4-4767-a800-f9a66b67804e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:02.224871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:02.226151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:02.227053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:02.227053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:02.227053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:02.227053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 215/437] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:02.228634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1df4-7794-4b20-9901-05bdbd9901bb None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.228634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1df4-7794-4b20-9901-05bdbd9901bb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.228634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1df4-7794-4b20-9901-05bdbd9901bb None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.229764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 216/438] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:02.234834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937c46a-8ec9-456e-9d57-205fb9a91132 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.234834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937c46a-8ec9-456e-9d57-205fb9a91132 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.234834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937c46a-8ec9-456e-9d57-205fb9a91132 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.234834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 217/439] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:02.234834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937c46a-8ec9-456e-9d57-205fb9a91132 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:02.239621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 223/440] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 11 11:47:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:02.241242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238278c-beef-4baa-8465-a61dcc42ebb9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.241735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238278c-beef-4baa-8465-a61dcc42ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.242195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238278c-beef-4baa-8465-a61dcc42ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.263841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4238278c-beef-4baa-8465-a61dcc42ebb9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:02.265409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4238278c-beef-4baa-8465-a61dcc42ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:02.363837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 224/441] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:02.365249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd55a3-0adc-448e-95cc-6b1a9800e886 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.365594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd55a3-0adc-448e-95cc-6b1a9800e886 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.365926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd55a3-0adc-448e-95cc-6b1a9800e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.370953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937c46a-8ec9-456e-9d57-205fb9a91132 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:02.388791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-38bd55a3-0adc-448e-95cc-6b1a9800e886 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:02.390033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-38bd55a3-0adc-448e-95cc-6b1a9800e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:02.415362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:02.415970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.416240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.416540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.417190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:02.417483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:02.419276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:02.433413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 218/442] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:02.438676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:02.478783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 225/443] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:02.480571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd55a3-0adc-448e-95cc-6b1a9800e886 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:02.499055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:02.511626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:02.598783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f95b2d-7b97-43cc-b4d5-0f50bb02bd7c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:02.654904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:02.655554 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.655835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.656119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.665254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd55a3-0adc-448e-95cc-6b1a9800e886 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:02.669421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:02.670992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:02.690891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:02.691876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:02.692702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:02.692702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:02.692702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:02.696842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 219/444] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:02.697916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:02.724780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:02.725761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.726194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.726656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.744795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:02.753452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:02.754410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:02.755522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 226/445] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:02.756597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:02.814032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:02.824410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc9af-3c91-4a6e-9cef-8d38f3498e18 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:02.844879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:02.859925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:02.860567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.860842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.861111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.868631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:02.870158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:02.873205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bd7b8-a41d-4e23-acac-1472a390b082 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:02.882041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:02.883020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:02.883827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 220/446] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:02.884277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:02.913230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:02.913895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:02.914177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:02.914689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:02.933511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:02.943908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:02.944854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:02.945641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:02.946240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 227/447] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:02.946814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.007587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846c83b-7a8b-4ba5-9b16-81c3f6b2468f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.043584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.044206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.044475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.044735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.045380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:03.045667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.047086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.060045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 221/448] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:03.061038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.062458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc345d74-d848-4745-bf76-635d0bb22544 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.077328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:03.103573 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.104323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.104601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.104871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.106921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:03.117546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:03.123753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:03.124703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:03.125474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 228/449] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:03.126118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.172704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169a6b3-f465-4029-8c4a-b3cb0fe59114 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.212165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.212864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.213134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.213420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.214191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:03.214925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.215947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.224440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 222/450] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:03.225298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.248000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1443343-b9ff-4e34-bcc4-f86fe45ecf5d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.286717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.287195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.287468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.287723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.288539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:03.288949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.290837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.305996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 229/451] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:03.306859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.318595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:03.349157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafa61f-6ba8-4bad-b98a-8530327c024b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.373126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:03.390093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.390986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.391426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.391856 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.392925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:03.393339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.395422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.405047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 223/452] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:03.405989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.440785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5264f-7de6-4c6a-a9f5-e08ba361ce0f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.487230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.487887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.488162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.488424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.496407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.498008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:03.512262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:03.514029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 230/453] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:03.515335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.559466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38858b8-9880-4d2a-bbc7-c18eede17edf None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.613582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.614205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.614480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.614776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.615768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:03.615768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.617143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.619734 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:03.627440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 224/454] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:03.628401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.640470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e859ddf-a65b-4440-a3ff-bae92ba6343a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.655950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:03.679116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.679903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.680170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.680435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.692766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.694265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:03.709663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:03.710871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:03.711698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:03.711698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:03.711698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:03.711698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 231/455] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:03.711698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.770226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28919fb6-2d8e-4a90-9e38-07e52fa83fa4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.808237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.808849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.809119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.809403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.810182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] RBAC: Adding query filter params (role.id=e72e1826d36c4a618d9bb4023d8acd93, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=c3fb3dc7226c48f1a33c6e73d3ff32a6) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:03.810425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.811911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.818149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 225/456] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/role_assignments?user.id=c3fb3dc7226c48f1a33c6e73d3ff32a6&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=e72e1826d36c4a618d9bb4023d8acd93 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:03.819032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:03.865795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d01ac4-0ed9-4b8f-82b8-b6388022d2d9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:03.923625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:03.924714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:03.925165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:03.925589 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:03.927286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:03.946746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:03.949618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:03.971498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:03.972662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:03.973613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:03.973613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:03.973613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:03.978759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 232/457] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:03.980052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.006364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172632bb-1284-4764-bb6a-7eb883951a60 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.007256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:04.049305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.049305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.049644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.049883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.050467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:04.051028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.052311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:04.067013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 226/458] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:04.067807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.133393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e884bb-5747-42d5-b54d-6917a6b82cf8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.197652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.198438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.198799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.199137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.211870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.214261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:04.232026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:04.233229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:04.234340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:04.234340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:04.234340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:04.238193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 233/459] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:04.238952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.247033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548e9fa-4112-4216-b4cd-5408e4e4e754 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.289680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:04.311087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.312108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.312584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.313054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.314227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:04.314788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.317401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:04.330849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:04.337471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 227/460] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:04.337471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.380044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812cd03-b1a1-46e6-8963-a897ff11168c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.418505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.419173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.419438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.419701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.420352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:04.420647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.422067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:04.442593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 234/461] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:04.442593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.502644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059d6f3-4584-43ae-aaf6-d4c67b2b6d11 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.545890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.546717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.547150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.547594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/f947cc3d958a49549b74d210453f2ced/roles/e72e1826d36c4a618d9bb4023d8acd93` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.564330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=f947cc3d958a49549b74d210453f2ced, role_id=e72e1826d36c4a618d9bb4023d8acd93)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.565813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:04.581073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 228/462] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:47:04 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/f947cc3d958a49549b74d210453f2ced/roles/e72e1826d36c4a618d9bb4023d8acd93 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:47:04.581853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.596770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1543b-2ca8-44e9-b56b-675270d95548 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.643827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:04.652649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:04.663618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.664717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.665165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.665730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.668067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:04.668586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.670285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:04.698474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 235/463] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:04.700425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.767088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5216d-b246-4cf7-bf1a-3d317906a938 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.846902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.848563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.849273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.849886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.866931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.870450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:04.883714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b034-f8c3-464e-9c27-286f89e20345 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:04.895613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:04.896670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 11 11:47:04.897663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:04.898241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 229/464] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:47:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:04.899819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:04.952332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:04.953736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:04.954324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:04.954918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:04.971131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:04.974292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:05.000234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:05.001391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 11 11:47:05.002403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:05.004761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 236/465] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:05.007058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:05.113493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:05.120862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:05.133193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cf8f3-1259-46a5-8c82-c3800c34979b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:05.201649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:05.202795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:05.203282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:05.203750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:05.219548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:05.222293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:05.241832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700e44f-6127-45fc-b9fa-37cb09d0bf2d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:05.242144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:05.243746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 230/466] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:47:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:05.245962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:05.300092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:05.300723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:05.301007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:05.301260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:05.302009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:05.302310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:05.303815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:05.323523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 237/467] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 11 11:47:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:05.324432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:05.433170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbbfad-20a5-425e-a72f-ddcd35497731 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:05.443557 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:05.467575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7553a3-0ea1-4a20-8878-397275fcadfc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:05.470896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:05.471537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:05.471799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:05.472084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:05.472821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:05.473142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:05.475656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:05.502358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 238/468] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 11 11:47:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:05.502358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:05.537178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:05.537981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:05.538358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:05.538761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:05.539688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:05.540082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:05.542011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:05.574153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 231/469] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Oct 11 11:47:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:05.574153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:05.591833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:05.723209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db574c0-62a1-488d-b8a8-6f774e5884fb None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:05.749883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf12ad-c006-4d82-bb20-b87aac398a97 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:05.787070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:05.788149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:05.788425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:05.788876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:05.820292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:05.821663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:05.822346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:05.823315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:05.892548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:05.914920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:05.917680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:05.935825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:05.947064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:05.949255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:06.079144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 232/470] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:47:06.079144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:06.081881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 239/471] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:47:06.082966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:06.171100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:06.216960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de68f1-0849-4326-9fb0-846bf9919c9c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:06.253417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f373cea-8fe4-4ee2-aec9-d8432c952193 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:06.259399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:06.260044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:06.260388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:06.260644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:06.273002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:06.273779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:06.275506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:06.293319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:06.302847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:06.304722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:06.304722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:06.304722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:06.304722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 240/472] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:06.304722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:06.323315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:06.324503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:06.325201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:06.325683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:06.414241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:06.416711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:06.466980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443929-3e1a-4a46-a5f2-65355b37dc12 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:06.491247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:06.516774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752f6c-166e-4714-9364-971f8ad5c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:06.517602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752f6c-166e-4714-9364-971f8ad5c584 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:06.518540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752f6c-166e-4714-9364-971f8ad5c584 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:06.519166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752f6c-166e-4714-9364-971f8ad5c584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:06.533772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84752f6c-166e-4714-9364-971f8ad5c584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:06.535840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84752f6c-166e-4714-9364-971f8ad5c584 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-84752f6c-166e-4714-9364-971f8ad5c584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:06.552679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:06.554264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:06.555226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:06.555226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:06.555226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:06.558505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 241/473] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:06.559895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29ceb-dbda-4af0-9434-39427137521b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:06.560160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29ceb-dbda-4af0-9434-39427137521b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:06.560458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b29ceb-dbda-4af0-9434-39427137521b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:06.562010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 242/474] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:06.562497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29ceb-dbda-4af0-9434-39427137521b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:06.574295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 233/475] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:47:06.574295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:06.588043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:06.688137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f778aa-8e8d-4076-83b6-4c9af68dc57d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:06.709019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b29ceb-dbda-4af0-9434-39427137521b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:06.732231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b192-5068-4340-9894-6996b5967eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:06.732864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b192-5068-4340-9894-6996b5967eac None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:06.733142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b192-5068-4340-9894-6996b5967eac None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:06.733409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b192-5068-4340-9894-6996b5967eac None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:06.734075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b192-5068-4340-9894-6996b5967eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:06.734374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b192-5068-4340-9894-6996b5967eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:06.735829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b192-5068-4340-9894-6996b5967eac None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:06.749188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 234/476] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:06.750186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e2a20-cbd3-423c-b193-2b96274c5e37 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:06.750589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e2a20-cbd3-423c-b193-2b96274c5e37 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:06.750863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e2a20-cbd3-423c-b193-2b96274c5e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:06.771974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e80e2a20-cbd3-423c-b193-2b96274c5e37 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:06.773557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e80e2a20-cbd3-423c-b193-2b96274c5e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:06.775434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:06.776105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:06.776370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:06.776629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:06.777281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:06.777571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:06.778993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:06.795303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 243/477] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:06.796101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:06.842311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:06.869767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:06.886627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 235/478] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:06.886627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e2a20-cbd3-423c-b193-2b96274c5e37 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:06.980327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47a9ce-064b-405f-beca-b1a59f3f385f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.039973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.040865 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.041276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.041829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.059311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.061294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.061666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e2a20-cbd3-423c-b193-2b96274c5e37 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:07.083365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:07.084521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:07.085541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:07.085541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:07.085541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:07.087730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 244/479] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:07.088927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.127604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.128853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.129447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.130101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.143362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.146442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:07.168903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:07.169885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:07.170763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:07.174616 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 236/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:07.174616 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.193365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:07.217522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b1bbd-cdd7-4b1f-ad02-e54c1884da10 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.247645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:07.257691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.258342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.258646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.258918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.266244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.267740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:07.281674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:07.282789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 245/481] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:07.283803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.295811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd0331-52ed-4418-8fe7-7535116fddbc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.331748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.332370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.332649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.332916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.333567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:07.333865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.335313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.347915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 237/482] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:07.348820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.428422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124d52-2486-47e3-ac63-6cf46d859513 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.458674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53ff4-918f-42ce-ab0f-0e8c9576652a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.471701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe40a6-30d9-42fd-9a67-067cc1351c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.472299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe40a6-30d9-42fd-9a67-067cc1351c92 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.472597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe40a6-30d9-42fd-9a67-067cc1351c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.472854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe40a6-30d9-42fd-9a67-067cc1351c92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.482851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:07.484994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe40a6-30d9-42fd-9a67-067cc1351c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d8fe40a6-30d9-42fd-9a67-067cc1351c92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:07.492507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:07.493604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:07.494386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 246/483] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:07.495894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391bcb5-6dfc-4d9d-ad62-e599d14c7480 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.496166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391bcb5-6dfc-4d9d-ad62-e599d14c7480 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.496430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391bcb5-6dfc-4d9d-ad62-e599d14c7480 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.497721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 247/484] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:07.498427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391bcb5-6dfc-4d9d-ad62-e599d14c7480 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.502463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:07.503106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.504180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.504686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.505071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.505978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:07.506439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.508208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.526935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 238/485] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:07.527805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.612426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391bcb5-6dfc-4d9d-ad62-e599d14c7480 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.648560 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.649175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.649444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.649718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.650404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:07.650785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.652269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.659344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dacefc-b588-4c89-8888-4abeacc6044a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.671809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 248/486] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:07.673313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.703338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe67a3-d53d-4639-a7ec-97c1ee35c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.703976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe67a3-d53d-4639-a7ec-97c1ee35c5aa None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.704250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe67a3-d53d-4639-a7ec-97c1ee35c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.704512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe67a3-d53d-4639-a7ec-97c1ee35c5aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.711719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe67a3-d53d-4639-a7ec-97c1ee35c5aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.713244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe67a3-d53d-4639-a7ec-97c1ee35c5aa None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-2cbe67a3-d53d-4639-a7ec-97c1ee35c5aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:07.726244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:07.727967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 239/487] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173874-1f00-4190-ba54-aeef945fcf37 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.729587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173874-1f00-4190-ba54-aeef945fcf37 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.730719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173874-1f00-4190-ba54-aeef945fcf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.750006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-22173874-1f00-4190-ba54-aeef945fcf37 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:07.751265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-22173874-1f00-4190-ba54-aeef945fcf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:07.763887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:07.791647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:07.806343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577351-71d6-417c-af06-93ef28645f63 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:07.830195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 240/488] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:07.831120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22173874-1f00-4190-ba54-aeef945fcf37 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.867187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:07.869024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:07.870036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:07.870654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:07.872064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:07.872703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:07.875700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:07.898323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 249/489] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:07.898323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:07.987536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22173874-1f00-4190-ba54-aeef945fcf37 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.047250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.047690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378575-a5ad-4d3d-bd1c-2dd5da8e9235 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.048246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.048632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.048951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.050756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] RBAC: Adding query filter params (role.id=e72e1826d36c4a618d9bb4023d8acd93, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=b78db6f3cf17421898e1597c65998fad) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:08.051177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:08.053608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:08.070604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 241/490] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/role_assignments?user.id=b78db6f3cf17421898e1597c65998fad&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=e72e1826d36c4a618d9bb4023d8acd93 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:08.070604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:08.108222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:08.126432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.127160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:08.127440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.127829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.128270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.129640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] RBAC: Adding query filter params (role.id=e72e1826d36c4a618d9bb4023d8acd93, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=bb63e30c48464c1ebe9305c620291c5d) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:08.130159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:08.132525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:08.141924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 250/491] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:07 2022] GET /identity/v3/role_assignments?user.id=bb63e30c48464c1ebe9305c620291c5d&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=e72e1826d36c4a618d9bb4023d8acd93 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:08.143081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:08.262780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115afb-c81b-4dc7-b5ed-9c97b13db970 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.317193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.318148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.318148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.318400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.319191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:08.319497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:08.322324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:08.342101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 242/492] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:08.342101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:08.377966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ef2f-2ebd-4403-9908-ec1092312ade None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.430386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.431102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.431379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.431645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.444715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:08.446235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:08.465977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:08.467733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:08.468921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:08.468921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:08.468921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:08.470669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 251/493] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:08.471983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:08.495006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:08.497981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a687-ec9e-48b8-8def-0ef8adac5b19 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.527083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:08.552060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.553310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.553801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.554331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.571447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:08.579019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:08.580017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:08.580805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:08.583986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 243/494] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:08.585099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:08.606403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5ba88-3a46-4841-8653-64914529a796 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.648031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.648732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.649103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.649495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.650343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] RBAC: Adding query filter params (role.id=e72e1826d36c4a618d9bb4023d8acd93, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=985db5d7ded74dbeaa8fae4515fea049) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:08.650829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:08.652425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:08.659464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 252/495] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/role_assignments?user.id=985db5d7ded74dbeaa8fae4515fea049&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=e72e1826d36c4a618d9bb4023d8acd93 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:08.668441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:08.758618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed93fb-7e9f-4efe-88c6-5087df58c8af None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.843256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.845640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.846286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.848151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.849166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:08.849778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:08.851672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:08.880393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 244/496] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:08.887405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:08.908404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba2e81-a860-4ff6-b4c8-82976cb647e4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:08.913260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:08.923867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:08.964713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:08.965340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:08.965611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:08.965874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:08.966584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:08.966876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:08.968318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:08.978447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 253/497] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:08.987385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:09.068272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15805ca-b793-4371-8dcb-40fc6c74ff1a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:09.112183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:09.113357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:09.113835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:09.114297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:09.129602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:09.133111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:09.163320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:09.164252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:09.165157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:09.170511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 245/498] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:09.174267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeffd9-4a35-4254-aeec-cd6d391744c8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:09.175542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:09.219888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:09.221099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:09.221630 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:09.222124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:09.246945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:09.248943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:09.282227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:09.283318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:09.284674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:09.284674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:09.284674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:09.288753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 254/499] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:09.297681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:09.337770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:09.353537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:09.389164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93468870-6ed9-4fc0-bec6-6c23ac5ecef6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:09.436568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:09.438301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:09.439470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:09.439943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:09.440901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:09.441647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:09.444673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:09.491519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 246/500] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 11 11:47:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:09.498028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:09.545050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ad408-798d-49f2-a9d4-a59edef162c6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:09.607242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:09.607874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:09.608153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:09.608419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:09.609079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:09.609386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:09.610788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:09.636737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 255/501] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:09.642423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:09.725465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf4514-efb8-4892-9cc4-1c302a8c4692 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:09.784860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:09.791365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:09.801645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:09.802396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:09.802769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:09.803096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:09.823937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643abe03-892f-481a-b147-3134ec82f377 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:09.825102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:09.827599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:09.859821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:09.861088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:09.862154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:09.862154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:09.862154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:09.862154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 247/502] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:09.875664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:09.880800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:09.882043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:09.882499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:09.883005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:09.897347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:09.900104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:09.936285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:09.937473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:09.938716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:09.942442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 256/503] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:09.950448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:10.144859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ecf83-8483-4a7f-a154-92822f00eccc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:10.159028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cd353-e8a0-48f0-833e-6dded6710467 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:10.217880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:10.218511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:10.219247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:10.219863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:10.220161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:10.220406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:10.221133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:10.221435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:10.222907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:10.225082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:10.225391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:10.226055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:10.226356 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:10.227801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:10.250737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:10.253823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 248/504] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:10.262194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:10.273731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 257/505] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 11 11:47:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:10.283990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:10.370781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:10.489914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3251a-4ddf-487d-b97e-da32f43f073b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:10.560531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:10.562667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:10.563543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:10.564165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:10.588220 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307d2ad-8a36-4a44-80dd-5ec4aba72f33 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:10.670480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:10.671489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:10.671489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:10.671829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:10.686227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:10.695024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:10.696160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:10.707192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:10.710462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:10.719138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:10.721028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:10.722771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:10.727243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 249/506] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:10.735749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:10.990052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 258/507] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 11 11:47:10.999594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:11.030227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6341ce-da52-480f-99d6-37992c45646e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:11.040164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:11.164686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b8175-4ab1-4859-b944-5cc5b4cfdd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:11.165760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b8175-4ab1-4859-b944-5cc5b4cfdd58 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.166299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b8175-4ab1-4859-b944-5cc5b4cfdd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.166843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b8175-4ab1-4859-b944-5cc5b4cfdd58 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.168529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b8175-4ab1-4859-b944-5cc5b4cfdd58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:11.169076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b8175-4ab1-4859-b944-5cc5b4cfdd58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:11.171884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b8175-4ab1-4859-b944-5cc5b4cfdd58 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:11.218741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 250/508] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:11.221446 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d03c-99a5-4818-b23f-94af19428a74 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.221969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d03c-99a5-4818-b23f-94af19428a74 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.222435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d03c-99a5-4818-b23f-94af19428a74 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.224439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 251/509] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:11.229788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d03c-99a5-4818-b23f-94af19428a74 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:11.282980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:11.294530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f679b-0290-4c6d-bd5c-e914c9d6c8b3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:11.342712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f70c2-027c-4f39-a08a-cc1c406d9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:11.343362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f70c2-027c-4f39-a08a-cc1c406d9348 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.343636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f70c2-027c-4f39-a08a-cc1c406d9348 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.343914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f70c2-027c-4f39-a08a-cc1c406d9348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.356533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f70c2-027c-4f39-a08a-cc1c406d9348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:11.358200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f70c2-027c-4f39-a08a-cc1c406d9348 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:11.366088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d03c-99a5-4818-b23f-94af19428a74 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9a4f70c2-027c-4f39-a08a-cc1c406d9348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:11.375686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:11.377410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:11.379091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:11.379091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:11.379091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:11.379091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 259/510] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:11.379091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9e63b-6743-402d-9573-51c1b8587eb0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.379091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9e63b-6743-402d-9573-51c1b8587eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.379091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9e63b-6743-402d-9573-51c1b8587eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.398979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ccd9e63b-6743-402d-9573-51c1b8587eb0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:11.400213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ccd9e63b-6743-402d-9573-51c1b8587eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:11.438314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fa631-25fa-4608-b42e-ddd026b40d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:11.439565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fa631-25fa-4608-b42e-ddd026b40d5e None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.440034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fa631-25fa-4608-b42e-ddd026b40d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.440408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fa631-25fa-4608-b42e-ddd026b40d5e None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/c3fb3dc7226c48f1a33c6e73d3ff32a6/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.443109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fa631-25fa-4608-b42e-ddd026b40d5e None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=c3fb3dc7226c48f1a33c6e73d3ff32a6, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:11.445004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6fa631-25fa-4608-b42e-ddd026b40d5e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:11.462797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 252/511] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:47:11 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/c3fb3dc7226c48f1a33c6e73d3ff32a6/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:47:11.464505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f2a9-e957-4bec-827c-5ec078277c44 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.464915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f2a9-e957-4bec-827c-5ec078277c44 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.465315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f2a9-e957-4bec-827c-5ec078277c44 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.467133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 253/512] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:11.468493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f2a9-e957-4bec-827c-5ec078277c44 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:11.522992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 260/513] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:11.526008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4c658-6e04-4653-8497-e47d419bf88b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.526996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4c658-6e04-4653-8497-e47d419bf88b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.527692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4c658-6e04-4653-8497-e47d419bf88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.537647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:11.568547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-61a4c658-6e04-4653-8497-e47d419bf88b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:11.571805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-61a4c658-6e04-4653-8497-e47d419bf88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:11.728536 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 261/514] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:11.744501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f2a9-e957-4bec-827c-5ec078277c44 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:11.783817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:11.784445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:11.784730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:11.784974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:11.785627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:11.785932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:11.787372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:11.801477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 254/515] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:11.808026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4c658-6e04-4653-8497-e47d419bf88b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:11.833927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:11.927595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:12.030943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4c658-6e04-4653-8497-e47d419bf88b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:12.084551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:12.098272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe720ddc-0a83-4f5b-b14e-86e0b870c456 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:12.099903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:12.101112 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.101667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.102950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.115486 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:12.118349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:12.140396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:12.141335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:12.142174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:12.143122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:12.143991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 262/516] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:12.144293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.144763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.145195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.145845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:12.146192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:12.147918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:12.162953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:12.164070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:12.164904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:12.173678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 255/517] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 11 11:47:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:12.175363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:12.264731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:12.326405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948a5ef-ecd6-4ae6-ae7c-484fdfa04070 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:12.364188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72528c-54ac-4885-9edb-ffe985299f46 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:12.383463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:12.384510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.384945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.385379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.403582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:12.405956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:12.430994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:12.433071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:12.434905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:12.434905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:12.434905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:12.434905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 263/518] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:12.434905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:12.448951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6ac64-7995-4676-82cd-688991903c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:12.450891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6ac64-7995-4676-82cd-688991903c22 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.451378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6ac64-7995-4676-82cd-688991903c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.451853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6ac64-7995-4676-82cd-688991903c22 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.453193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6ac64-7995-4676-82cd-688991903c22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:12.453727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6ac64-7995-4676-82cd-688991903c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:12.456472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6ac64-7995-4676-82cd-688991903c22 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:12.479596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 256/519] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:12.482050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2faa08-92eb-4b73-aa95-70b88572ff7b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.482577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2faa08-92eb-4b73-aa95-70b88572ff7b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.483045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2faa08-92eb-4b73-aa95-70b88572ff7b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.485828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 257/520] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:12.488803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2faa08-92eb-4b73-aa95-70b88572ff7b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:12.508836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:12.617483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03397ceb-d1ee-4986-9efd-a0931867f02c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:12.651818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:12.676627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2faa08-92eb-4b73-aa95-70b88572ff7b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:12.677577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:12.678641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.679156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.679665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.680745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:12.681226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:12.683250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:12.698466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 264/521] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 11 11:47:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:12.698466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:12.738354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c4881-00f3-439a-b325-c2ecae5e2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:12.739570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4881-00f3-439a-b325-c2ecae5e2b55 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.740094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4881-00f3-439a-b325-c2ecae5e2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.740485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4881-00f3-439a-b325-c2ecae5e2b55 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.741504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c4881-00f3-439a-b325-c2ecae5e2b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:12.742059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c4881-00f3-439a-b325-c2ecae5e2b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:12.744611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c4881-00f3-439a-b325-c2ecae5e2b55 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:12.771235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 258/522] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:12.774999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a775-558b-4ce3-9c7d-346add274b0c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.776338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a775-558b-4ce3-9c7d-346add274b0c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.776775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a775-558b-4ce3-9c7d-346add274b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.811364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8488a775-558b-4ce3-9c7d-346add274b0c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:12.814304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8488a775-558b-4ce3-9c7d-346add274b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:12.834932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70529c-cc8f-4307-a96f-48523ff6b837 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:12.898232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:12.899576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:12.900273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:12.900827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:12.902426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] RBAC: Adding query filter params (role.id=e72e1826d36c4a618d9bb4023d8acd93, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=f947cc3d958a49549b74d210453f2ced) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:12.902844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:12.906272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:12.908470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:12.923839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 265/523] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:12 2022] GET /identity/v3/role_assignments?user.id=f947cc3d958a49549b74d210453f2ced&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=e72e1826d36c4a618d9bb4023d8acd93 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:12.923839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:12.924258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 259/524] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:12.924860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a775-558b-4ce3-9c7d-346add274b0c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:13.093831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:13.213394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a775-558b-4ce3-9c7d-346add274b0c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:13.216348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f47882-7fa4-49dc-9b67-9d8f06319549 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:13.255321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:13.256437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:13.256940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:13.257405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:13.258268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:13.259798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:13.260336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:13.260463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:13.260747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:13.261012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:13.261659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:13.261961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:13.263438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:13.272954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 266/525] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 11 11:47:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:13.273870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:13.303250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 260/526] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:47:12 2022] POST /identity/v3/users => generated 254 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:13.397314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31610ea4-cb8d-4ffd-88d3-30e2cf4e3ef9 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:13.427011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:13.444817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:13.445831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:13.446324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:13.446847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] PATH_INFO: `/v3/services/network` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:13.447819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:13.450474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:13.472292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:13.473300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:13.474113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:13.474874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 267/527] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:13 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:13.481678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:13.591121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:13.673632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b298a-170f-4535-8e24-029078c12b14 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:13.720350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4ce0c-af3d-4090-9dec-1674cb591a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:13.720998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ce0c-af3d-4090-9dec-1674cb591a6d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:13.721276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ce0c-af3d-4090-9dec-1674cb591a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:13.721546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4ce0c-af3d-4090-9dec-1674cb591a6d None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:13.722217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4ce0c-af3d-4090-9dec-1674cb591a6d None admin] RBAC: Adding query filter params (name=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:13.722621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4ce0c-af3d-4090-9dec-1674cb591a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:13.724023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4ce0c-af3d-4090-9dec-1674cb591a6d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:13.729996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 261/528] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:13.736517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:13.936440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39125feb-6ba5-44fa-a3cb-61e95ffbaf7e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:14.001807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d463b-2fd7-41c3-acca-b8e875e1f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:14.001807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d463b-2fd7-41c3-acca-b8e875e1f5da None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:14.001807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d463b-2fd7-41c3-acca-b8e875e1f5da None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:14.002169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d463b-2fd7-41c3-acca-b8e875e1f5da None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:14.003377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d463b-2fd7-41c3-acca-b8e875e1f5da None admin] RBAC: Adding query filter params (type=network) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:14.003913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d463b-2fd7-41c3-acca-b8e875e1f5da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:14.006593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d463b-2fd7-41c3-acca-b8e875e1f5da None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:14.015192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 268/529] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:14.175262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a895-1266-465c-a1cd-ddc17ef69551 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:14.175790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a895-1266-465c-a1cd-ddc17ef69551 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:14.176221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9a895-1266-465c-a1cd-ddc17ef69551 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:14.178165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 262/530] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:14.184695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad19e5-2a3d-493b-8822-faf4bbc24234 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:14.185342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad19e5-2a3d-493b-8822-faf4bbc24234 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:14.185800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad19e5-2a3d-493b-8822-faf4bbc24234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:14.215523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-15ad19e5-2a3d-493b-8822-faf4bbc24234 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:14.217128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-15ad19e5-2a3d-493b-8822-faf4bbc24234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:14.272239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:14.322164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 269/531] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:14.638594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a895-1266-465c-a1cd-ddc17ef69551 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:14.789379 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9a895-1266-465c-a1cd-ddc17ef69551 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:14.809223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:14.835973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:14.836848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:14.837300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:14.837742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:14.857605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:14.866706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:14.867675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:14.868486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:14.869660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 263/532] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:14.875448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad19e5-2a3d-493b-8822-faf4bbc24234 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:15.079772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad19e5-2a3d-493b-8822-faf4bbc24234 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:15.138822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:15.139465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:15.139741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:15.140005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:15.140705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:15.141006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:15.142419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:15.154939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 270/533] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:47:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:15.161577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:15.383831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca773e84-d872-4bb2-b3b4-f947ae24bfe6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:15.446751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:15.447899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:15.448334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:15.448794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:15.474624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:15.477204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:15.514392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:15.515429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:15.516358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:15.516358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:15.516358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:15.520936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 264/534] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:15.523038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:15.589601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:15.724468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ce72c-d540-4c0a-827e-bad4566050f0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:15.774391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd4b1a-e93e-4b2e-a67f-6678ec92c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:15.775531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd4b1a-e93e-4b2e-a67f-6678ec92c65a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:15.776022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd4b1a-e93e-4b2e-a67f-6678ec92c65a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:15.776522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd4b1a-e93e-4b2e-a67f-6678ec92c65a None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:15.777426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd4b1a-e93e-4b2e-a67f-6678ec92c65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:15.777969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd4b1a-e93e-4b2e-a67f-6678ec92c65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:15.779647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd4b1a-e93e-4b2e-a67f-6678ec92c65a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:15.802983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 271/535] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:15.812335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:15.892096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:15.999238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a731d4-f9c8-4b5f-bd5e-ac80826ffc24 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:15.999752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a731d4-f9c8-4b5f-bd5e-ac80826ffc24 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:16.000047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a731d4-f9c8-4b5f-bd5e-ac80826ffc24 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:16.012193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 272/536] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:16.018473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20fee-d133-4d37-91ac-b7bdc59352fa None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:16.018943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20fee-d133-4d37-91ac-b7bdc59352fa None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:16.019366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20fee-d133-4d37-91ac-b7bdc59352fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:16.083743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-85a20fee-d133-4d37-91ac-b7bdc59352fa None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:16.085008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-85a20fee-d133-4d37-91ac-b7bdc59352fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:16.086749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe635307-be30-4217-a63c-62f34a0deb3b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:16.197791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ba6a8-e5d7-4a80-aca3-98c94a891805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:16.199837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ba6a8-e5d7-4a80-aca3-98c94a891805 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:16.200310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ba6a8-e5d7-4a80-aca3-98c94a891805 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:16.200775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ba6a8-e5d7-4a80-aca3-98c94a891805 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:16.212287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ba6a8-e5d7-4a80-aca3-98c94a891805 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:16.216157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ba6a8-e5d7-4a80-aca3-98c94a891805 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-b71ba6a8-e5d7-4a80-aca3-98c94a891805 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:16.232766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:16.233850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:16.234888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:16.241635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 265/537] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Oct 11 11:47:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:16.241635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197b51b-eb80-48cc-b44a-1862a81d62d5 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:16.241635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197b51b-eb80-48cc-b44a-1862a81d62d5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:16.241635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197b51b-eb80-48cc-b44a-1862a81d62d5 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:16.242456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 266/538] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:16.247074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197b51b-eb80-48cc-b44a-1862a81d62d5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:16.270597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 273/539] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 11 11:47:16.273069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8422-2416-4c71-9d86-c2541d53a5d6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:16.273678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8422-2416-4c71-9d86-c2541d53a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:16.274148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8422-2416-4c71-9d86-c2541d53a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:16.330190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-24cd8422-2416-4c71-9d86-c2541d53a5d6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:16.334622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-24cd8422-2416-4c71-9d86-c2541d53a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:16.393069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:16.517896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:16.540992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197b51b-eb80-48cc-b44a-1862a81d62d5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:16.578682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 274/540] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:16.580606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8422-2416-4c71-9d86-c2541d53a5d6 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:16.624669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:16.625299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:16.625574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:16.625841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:16.626605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:16.626909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:16.628611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:16.677443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 267/541] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 11 11:47:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:16.683554 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:16.778547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8422-2416-4c71-9d86-c2541d53a5d6 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:16.910514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:16.912483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:16.913361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:16.914145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:16.934692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:16.944331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:16.946167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:16.947885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:16.950740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 275/542] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:16.951723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:16.972027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:17.016151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd4ec-9cbf-44d8-87e9-1e9a8b0af84b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:17.067477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c770d6e-9831-40a9-b335-0804c879318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:17.068016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c770d6e-9831-40a9-b335-0804c879318c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:17.068291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c770d6e-9831-40a9-b335-0804c879318c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:17.068547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c770d6e-9831-40a9-b335-0804c879318c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:17.100434 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:17.140733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ebe7-cb47-4959-8659-8de30f308e67 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:17.178925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c770d6e-9831-40a9-b335-0804c879318c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:17.180586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c770d6e-9831-40a9-b335-0804c879318c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:17.210793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:17.211840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:17.212324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:17.212799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:17.214107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:17.216831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:17.246640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 276/543] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:47:16 2022] POST /identity/v3/services => generated 251 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:17.248628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:17.332792 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 268/544] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 11 11:47:17.334342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68889-06b4-4706-a09a-af974615b5aa None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:17.334641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68889-06b4-4706-a09a-af974615b5aa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:17.335030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68889-06b4-4706-a09a-af974615b5aa None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:17.341215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 269/545] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:17.342462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68889-06b4-4706-a09a-af974615b5aa None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:17.413092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:17.433474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:17.496816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68889-06b4-4706-a09a-af974615b5aa None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:17.500987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b80af0-70aa-4460-bcc6-8985ba0be29c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:17.542056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2ea5-2b9a-4cf5-a4b2-3980adc7a381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:17.543426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2ea5-2b9a-4cf5-a4b2-3980adc7a381 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:17.543894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2ea5-2b9a-4cf5-a4b2-3980adc7a381 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:17.544324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2ea5-2b9a-4cf5-a4b2-3980adc7a381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:17.557845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd2ea5-2b9a-4cf5-a4b2-3980adc7a381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:17.559921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd2ea5-2b9a-4cf5-a4b2-3980adc7a381 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:17.575671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:17.576726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:17.577244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-dacd2ea5-2b9a-4cf5-a4b2-3980adc7a381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:17.578697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:17.579574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:17.580503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:17.580503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:17.580503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:17.580735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:17.580735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:17.580735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:17.583706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:17.591673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 270/546] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:17.593874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa42991-7ea5-4658-b48e-17ccdb82ac80 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:17.593874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa42991-7ea5-4658-b48e-17ccdb82ac80 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:17.594273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa42991-7ea5-4658-b48e-17ccdb82ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:17.603491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 277/547] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:17.604640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:17.622461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9aa42991-7ea5-4658-b48e-17ccdb82ac80 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:17.624616 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9aa42991-7ea5-4658-b48e-17ccdb82ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:17.756485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 271/548] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:17.757756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa42991-7ea5-4658-b48e-17ccdb82ac80 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:17.790045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:17.791803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf02f2-406a-47b6-9c9f-e82a233dffba None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:17.881175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:17.886805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:17.887385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:17.887862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:17.889098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:17.889621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:17.892238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:17.899652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:17.948777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 278/549] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:17.957942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:18.039636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa42991-7ea5-4658-b48e-17ccdb82ac80 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:18.112051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94a6e2-e9ab-4bf4-9100-f7fd45a356bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:18.113234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a6e2-e9ab-4bf4-9100-f7fd45a356bb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.113774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a6e2-e9ab-4bf4-9100-f7fd45a356bb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.114307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a6e2-e9ab-4bf4-9100-f7fd45a356bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.128828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94a6e2-e9ab-4bf4-9100-f7fd45a356bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:18.130840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94a6e2-e9ab-4bf4-9100-f7fd45a356bb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5c94a6e2-e9ab-4bf4-9100-f7fd45a356bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:18.152759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:18.153713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:18.154573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:18.154573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:18.154573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:18.156401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 272/550] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:18.158473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a5b7-d89c-4bce-a153-7c8635f61ce7 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.158988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a5b7-d89c-4bce-a153-7c8635f61ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.159391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007a5b7-d89c-4bce-a153-7c8635f61ce7 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.166225 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 273/551] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:18.167533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a5b7-d89c-4bce-a153-7c8635f61ce7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:18.191700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533e875-0023-4c90-b3c3-197e9c04a8d8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:18.258759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edfc52-5871-47f3-afd2-b8ec68f33b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:18.259699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edfc52-5871-47f3-afd2-b8ec68f33b54 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.260189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edfc52-5871-47f3-afd2-b8ec68f33b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.260795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edfc52-5871-47f3-afd2-b8ec68f33b54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.269916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edfc52-5871-47f3-afd2-b8ec68f33b54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:18.271713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edfc52-5871-47f3-afd2-b8ec68f33b54 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-a1edfc52-5871-47f3-afd2-b8ec68f33b54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:18.286186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:18.287163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:18.288115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:18.290180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 279/552] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:18.291761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4b17c-bf81-4d85-9b9f-c858be2820a2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.292219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4b17c-bf81-4d85-9b9f-c858be2820a2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.292620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4b17c-bf81-4d85-9b9f-c858be2820a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.304872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:18.313697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-77f4b17c-bf81-4d85-9b9f-c858be2820a2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:18.315149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-77f4b17c-bf81-4d85-9b9f-c858be2820a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:18.339372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007a5b7-d89c-4bce-a153-7c8635f61ce7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:18.377946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:18.389325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:18.389971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.390264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.390505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.391425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:18.391560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:18.393005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:18.407216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 274/553] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:18.407482 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 280/554] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 11 11:47:18.408496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4b17c-bf81-4d85-9b9f-c858be2820a2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:18.420305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:18.600687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4b17c-bf81-4d85-9b9f-c858be2820a2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:18.639198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b351a-99f7-47e8-bf35-f15581751c76 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:18.676025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:18.678463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.679724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.680419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.681629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:18.682527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:18.685584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:18.699804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:18.700623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.701144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.701497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.703304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 281/555] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:18.708958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:18.711270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:18.718360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:18.725427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:18.727215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:18.728896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 275/556] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:18.731672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:18.786206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:18.877226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4367d-77d5-4836-ab1c-fa5e4d89a198 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:18.893451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c7af-e145-4e29-abbe-b676e56a5d29 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:18.938125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:18.939096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.939526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.939924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.954254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:18.954811 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:18.955250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:18.955678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:18.956069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:18.957144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:18.957255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:18.959451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:18.976287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:18.978044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 282/557] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:18.979765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:18.996582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 276/558] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:47:18 2022] POST /identity/v3/services => generated 240 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:19.003264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:19.137229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:19.205877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eae8cb-3f59-42a8-9abd-348b72beb504 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:19.209851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:19.243070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06354b5d-ee71-4c56-8e58-578548f361ec None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:19.261429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:19.262234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:19.262710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:19.263300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:19.264148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=c3fb3dc7226c48f1a33c6e73d3ff32a6) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:19.264524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:19.266116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:19.275018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 283/559] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:18 2022] GET /identity/v3/role_assignments?user.id=c3fb3dc7226c48f1a33c6e73d3ff32a6&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:19.276030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:19.312367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:19.313677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:19.314330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:19.315447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:19.315892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:19.316355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:19.318803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:19.334603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 277/560] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:19.342688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:19.519100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9a79-089a-486b-ac34-43a4b1b4f291 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:19.582753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028f7d-b781-4de9-b9df-294fdb2e1d64 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:19.593965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:19.595720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:19.595888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:19.596458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:19.598088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:19.598771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:19.601648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:19.606241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:19.634722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:19.634722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:19.634722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:19.635332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:19.644816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 284/561] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 11 11:47:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:19.650120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:19.652322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:19.652778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:19.671314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:19.673101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:19.680830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:19.680830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:19.680830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:19.680830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 278/562] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:19.685209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:19.700517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:19.795168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad53dd8-b889-46df-a7e5-2bc8fe82fccc None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:19.837756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727261fe-763c-4011-bc34-27487929899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:19.838527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727261fe-763c-4011-bc34-27487929899b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:19.838829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727261fe-763c-4011-bc34-27487929899b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:19.839101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727261fe-763c-4011-bc34-27487929899b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:19.852036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727261fe-763c-4011-bc34-27487929899b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:19.853764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727261fe-763c-4011-bc34-27487929899b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-727261fe-763c-4011-bc34-27487929899b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:19.872716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:19.874983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:19.877031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:19.877031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:19.877031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:19.877031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 285/563] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:19.886398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727261fe-763c-4011-bc34-27487929899b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:19.892635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d7356-0516-4305-9b7a-6d4a25dcf93f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:19.960625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:19.962197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:19.963223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:19.963956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:19.965594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:19.966395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:19.969749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:20.010722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 279/564] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:20.014924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:20.019234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:20.051506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727261fe-763c-4011-bc34-27487929899b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:20.089170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:20.133576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:20.134581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:20.135134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:20.135823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:20.137048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:20.137561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:20.145953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:20.191896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 286/565] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:20.198307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:20.315042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d20a59-1c2b-4e10-bf8e-5b859326a6c7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:20.443073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:20.445698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:20.446179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:20.446677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:20.475011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:20.477804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:20.520831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:20.521853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:20.522855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:20.527899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba0609-0aba-47f1-9900-3f916b423912 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:20.531142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 280/566] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:47:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 517 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:20.532783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:20.631371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:20.631938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:20.632206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:20.632468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:20.646034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:20.647530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:20.657560 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:20.677819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:20.679499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:20.681353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 287/567] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 482 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:20.685460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:20.757642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:20.792591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd03c7-103d-4560-b595-de5e4f6264c7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:20.861758 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:20.862389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:20.862699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:20.862967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:20.863718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:20.864021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:20.865525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:20.873718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0158e03-9102-4fdd-8178-214eb8e94e24 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:20.895688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 281/568] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Oct 11 11:47:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:20.898184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:20.953800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:20.954441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:20.954761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:20.955008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:20.955739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:20.956037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:20.957532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:20.980859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 288/569] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:20.988148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:21.061433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21434031-c97c-4f1e-9d38-0a1ab3e2ae46 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:21.119701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f957779-1acb-425e-bc29-cf2a9265e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:21.120397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f957779-1acb-425e-bc29-cf2a9265e645 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:21.120665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f957779-1acb-425e-bc29-cf2a9265e645 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:21.120924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f957779-1acb-425e-bc29-cf2a9265e645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:21.134032 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:21.142536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f957779-1acb-425e-bc29-cf2a9265e645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:21.144041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f957779-1acb-425e-bc29-cf2a9265e645 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:21.152498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-4f957779-1acb-425e-bc29-cf2a9265e645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:21.163615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:21.164694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:21.165543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:21.165543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:21.165543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:21.168270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 282/570] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:21.170020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b425-8276-4024-bc5b-67fe5fe736ac None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:21.170516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b425-8276-4024-bc5b-67fe5fe736ac None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:21.171005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42b425-8276-4024-bc5b-67fe5fe736ac None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:21.173244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 283/571] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:21.174382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42b425-8276-4024-bc5b-67fe5fe736ac None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:21.239164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754984f-614e-4519-ba9d-1e6b200e9178 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:21.299244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978d2c8-6a11-4ffc-bbbc-a3c350627c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:21.300330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d2c8-6a11-4ffc-bbbc-a3c350627c72 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:21.300771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d2c8-6a11-4ffc-bbbc-a3c350627c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:21.301220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978d2c8-6a11-4ffc-bbbc-a3c350627c72 None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/f947cc3d958a49549b74d210453f2ced/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:21.305021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978d2c8-6a11-4ffc-bbbc-a3c350627c72 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=f947cc3d958a49549b74d210453f2ced, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:21.307801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978d2c8-6a11-4ffc-bbbc-a3c350627c72 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:21.333752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 289/572] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:47:20 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/f947cc3d958a49549b74d210453f2ced/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:47:21.336046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed4d2-c016-43ae-8a59-813bef6434f9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:21.336658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed4d2-c016-43ae-8a59-813bef6434f9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:21.337104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed4d2-c016-43ae-8a59-813bef6434f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:21.349983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42b425-8276-4024-bc5b-67fe5fe736ac None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:21.370227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-015ed4d2-c016-43ae-8a59-813bef6434f9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:21.372217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-015ed4d2-c016-43ae-8a59-813bef6434f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:21.411933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:21.413028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:21.413466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:21.413889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:21.415029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:21.415533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:21.418531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:21.442083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 284/573] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:21.450127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:21.502478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 290/574] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:21.549434 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:21.610729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81136-2d94-4ce0-8103-b41e7e93c1ec None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:21.665642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:21.666289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:21.666738 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:21.667028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:21.675432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:21.676921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:21.695548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:21.699258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:21.702470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 285/575] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:21.712417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed4d2-c016-43ae-8a59-813bef6434f9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:21.768515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:21.843077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed4d2-c016-43ae-8a59-813bef6434f9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:21.925198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:21.926204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:21.926712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:21.927176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:21.928574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:21.929139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:21.932196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:21.966769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 291/576] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:21.971719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:22.063326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:22.267225 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381035-08df-415d-a469-38394fa6ee31 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:22.281551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a20e81-b4ce-41e7-98cf-4951769d0e62 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:22.292979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:22.317863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:22.345599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:22.346253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.346521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.346818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.347413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:22.348798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:22.353809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:22.354493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.354784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.355049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/3acdcbc6be244b96a620a6e5ec894f0f/roles/e72e1826d36c4a618d9bb4023d8acd93` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:22.374329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:22.375376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:22.376755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:22.381758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 292/577] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 11 11:47:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:22.382069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:22.404183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=3acdcbc6be244b96a620a6e5ec894f0f, role_id=e72e1826d36c4a618d9bb4023d8acd93)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:22.406982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:22.439176 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 286/578] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:47:21 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/3acdcbc6be244b96a620a6e5ec894f0f/roles/e72e1826d36c4a618d9bb4023d8acd93 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:47:22.614219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297174c1-1bc8-4d2f-b843-e0fd6e1b385c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:22.682837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a71439-cd30-4b95-b5f1-2dd19af2b7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:22.683482 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a71439-cd30-4b95-b5f1-2dd19af2b7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.683754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a71439-cd30-4b95-b5f1-2dd19af2b7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.684014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a71439-cd30-4b95-b5f1-2dd19af2b7e4 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.684684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a71439-cd30-4b95-b5f1-2dd19af2b7e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:22.684982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a71439-cd30-4b95-b5f1-2dd19af2b7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:22.686519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a71439-cd30-4b95-b5f1-2dd19af2b7e4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:22.696050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 293/579] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 11 11:47:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:22.702851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:22.802906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b810-f418-4f78-aec3-3c27e96567fc None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.803886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b810-f418-4f78-aec3-3c27e96567fc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.804343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b810-f418-4f78-aec3-3c27e96567fc None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.806190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 294/580] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:47:22.812144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5b9d5-4502-48a3-95f3-474aacd34b45 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.815223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5b9d5-4502-48a3-95f3-474aacd34b45 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.815819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5b9d5-4502-48a3-95f3-474aacd34b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.842396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-51c5b9d5-4502-48a3-95f3-474aacd34b45 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:22.844012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-51c5b9d5-4502-48a3-95f3-474aacd34b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:22.902689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:22.914507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59574-7419-48f2-a0a4-ed871ac8a08d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:22.973161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 295/581] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:22.974384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:22.975342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8d9c-fa4d-48d0-9fa4-a00bd6dd298a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.975459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.975801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8d9c-fa4d-48d0-9fa4-a00bd6dd298a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.975903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.976220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc8d9c-fa4d-48d0-9fa4-a00bd6dd298a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.976326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.979145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 296/582] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:22.981923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:22.982895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:22.986130 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:22.987894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0c327-959a-4abf-8c80-88285cb0b241 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:22.988348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0c327-959a-4abf-8c80-88285cb0b241 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:22.988801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0c327-959a-4abf-8c80-88285cb0b241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:22.999711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 287/583] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 11 11:47:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:23.007588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:23.020071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9eb0c327-959a-4abf-8c80-88285cb0b241 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:23.021946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9eb0c327-959a-4abf-8c80-88285cb0b241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:23.110986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:23.214548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 297/584] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:23.260861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb45b8-f1b2-4047-8850-a5f223f6db5f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:23.262911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0c327-959a-4abf-8c80-88285cb0b241 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:23.335978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:23.337028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:23.337507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:23.338023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:23.339016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] RBAC: Adding query filter params (interface=public, service_id=c9cf1cdf85ba4508a30a76f6d9a78e8f, region_id=RegionOne) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:23.339557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:23.341170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:23.360944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 288/585] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:47:23 2022] GET /identity/v3/endpoints?service_id=c9cf1cdf85ba4508a30a76f6d9a78e8f&interface=public®ion_id=RegionOne => generated 194 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:23.367449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:23.383950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:23.391735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0c327-959a-4abf-8c80-88285cb0b241 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:23.443369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:23.444035 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:23.444312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:23.444579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:23.445189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:23.446610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:23.456371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:23.457444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:23.458307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:23.467131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 298/586] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:23 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:23.478186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:23.527117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:23.538065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04960c67-f114-435b-ac77-f0c60921140f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:23.606883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:23.608326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:23.609404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:23.610024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:23.611361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:23.612843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:23.626994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 289/587] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:23 2022] GET /identity/v3/services => generated 772 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:23.628834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:23.666929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b015f-0096-4bb7-9fde-db334a452ae2 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:23.806073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:23.810512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:23.812567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:23.813774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:23.815383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] RBAC: Adding query filter params (name=network) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:23.816242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:23.818737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:23.829327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 299/588] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:23.839875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:23.903193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:23.919427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948b90-ae08-49cc-a959-6ba19a7ee719 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:23.993279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:23.994651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:23.995289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:23.996619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:23.997908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:24.001161 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:24.020537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:24.021643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:24.022537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:24.031712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 290/589] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 11 11:47:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:24.038352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:24.054648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca96f-14dc-4a2b-9b94-e5cb9d65c431 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:24.081482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:24.136898 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c39b24-529f-405f-913c-a00c02453e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:24.139283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39b24-529f-405f-913c-a00c02453e5f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:24.139774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39b24-529f-405f-913c-a00c02453e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:24.140640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39b24-529f-405f-913c-a00c02453e5f None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:24.142293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c39b24-529f-405f-913c-a00c02453e5f None admin] RBAC: Adding query filter params (type=network) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:24.144302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c39b24-529f-405f-913c-a00c02453e5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:24.146329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c39b24-529f-405f-913c-a00c02453e5f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:24.158012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 300/590] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:24.163013 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a439d-b35d-42e5-8515-c83ed12b7832 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:24.163283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a439d-b35d-42e5-8515-c83ed12b7832 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:24.163551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a439d-b35d-42e5-8515-c83ed12b7832 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:24.166797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 301/591] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:24.170756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a439d-b35d-42e5-8515-c83ed12b7832 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:24.198878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7588b9-5ca9-4580-8b1e-583b4804394f None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:24.240021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0131584-279d-4722-a313-9450cde07c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:24.241076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131584-279d-4722-a313-9450cde07c26 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:24.241718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131584-279d-4722-a313-9450cde07c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:24.242169 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0131584-279d-4722-a313-9450cde07c26 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:24.243412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0131584-279d-4722-a313-9450cde07c26 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:24.243904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0131584-279d-4722-a313-9450cde07c26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:24.245646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0131584-279d-4722-a313-9450cde07c26 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:24.257764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 291/592] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:24.257764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82062b61-1a1a-46ba-b563-589084ac8f69 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:24.257764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82062b61-1a1a-46ba-b563-589084ac8f69 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:24.257764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82062b61-1a1a-46ba-b563-589084ac8f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:24.287560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-82062b61-1a1a-46ba-b563-589084ac8f69 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:24.290019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-82062b61-1a1a-46ba-b563-589084ac8f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:24.298593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:24.317337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a439d-b35d-42e5-8515-c83ed12b7832 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:24.364507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:24.365461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:24.365785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:24.366053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:24.366908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] RBAC: Adding query filter params (interface=public, service_id=8c3e1bad6d074dfbba398822df39191a, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:24.367214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:24.368666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:24.382444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 302/593] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:47:24 2022] GET /identity/v3/endpoints?service_id=8c3e1bad6d074dfbba398822df39191a&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:24.383938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:24.390224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 292/594] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:24.392221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82062b61-1a1a-46ba-b563-589084ac8f69 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:24.439369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:24.599854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f8a52-9c33-4a4c-ae4a-5ff1cde87dd1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:24.639926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:24.640812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:24.641254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:24.641668 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:24.642608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:24.643067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:24.644681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:24.650795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 303/595] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:24.675490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82062b61-1a1a-46ba-b563-589084ac8f69 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:24.748498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:24.749154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:24.749432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:24.749697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:24.750350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:24.751837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:24.760875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 293/596] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:24 2022] GET /identity/v3/services => generated 772 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:24.822855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:24.847678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:24.960009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f95b3-ab75-40bd-bdce-906e2c48c354 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:25.010087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:25.010830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:25.011107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:25.011374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:25.024788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:25.029861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:25.030888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:25.031733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 304/597] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:25.040541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:25.156912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:25.182760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1c7ee-bcff-4ac9-9572-f84b8f7f27bd None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:25.228159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d473-d899-4ae0-8e82-2286cb3a5cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:25.228753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d473-d899-4ae0-8e82-2286cb3a5cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:25.229025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d473-d899-4ae0-8e82-2286cb3a5cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:25.229286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d473-d899-4ae0-8e82-2286cb3a5cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:25.229970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d473-d899-4ae0-8e82-2286cb3a5cf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:25.230266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d473-d899-4ae0-8e82-2286cb3a5cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:25.231779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d473-d899-4ae0-8e82-2286cb3a5cf5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:25.250105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 294/598] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:25.259246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:25.360344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:25.388634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670f26b-8a27-49ef-aeae-82567eeaa13e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:25.389989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53400-fc56-467d-9796-11a34f6fdc2b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:25.390456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53400-fc56-467d-9796-11a34f6fdc2b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:25.391113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53400-fc56-467d-9796-11a34f6fdc2b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:25.398731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 295/599] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:47:25.403028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6b54-d2cd-45e0-8ba3-0d6a16098ce5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:25.403466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6b54-d2cd-45e0-8ba3-0d6a16098ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:25.403907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6b54-d2cd-45e0-8ba3-0d6a16098ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:25.427466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:25.428258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:25.428596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:25.428932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:25.446712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:25.447502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b30f6b54-d2cd-45e0-8ba3-0d6a16098ce5 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:25.448296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:25.449565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b30f6b54-d2cd-45e0-8ba3-0d6a16098ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:25.476146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:25.477170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:25.478040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:25.478040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:25.478040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:25.478040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 305/600] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:25.498689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:25.602977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 296/601] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:25.665779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab7e3-3d0f-4709-a1dc-1ed1e1977e07 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:25.698365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:25.715554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:25.716179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:25.716454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:25.716721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:25.717380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:25.717678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:25.719102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:25.732818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 306/602] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:25.741406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6b54-d2cd-45e0-8ba3-0d6a16098ce5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:25.841936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:25.878479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6b54-d2cd-45e0-8ba3-0d6a16098ce5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:25.926189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:25.926932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:25.927211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:25.927477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:25.939552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:25.941071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:25.954883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:25.955892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:25.956833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 297/603] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:47:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:25.965345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:26.124217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ba5d9-3697-42ff-8fde-d681aed11052 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:26.168381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:26.181563 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:26.182350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:26.182656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:26.182927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:26.183681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:26.183982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:26.185480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:26.205921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 307/604] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 11 11:47:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:26.218543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:26.278276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:26.380253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165639d-7cf8-4fc4-971d-7aae03a4bc8f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:26.442868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06066f1f-6611-46c2-913e-cb7ea80f8bd7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:26.456214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:26.457111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:26.457528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:26.457933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:26.512875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:26.513950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:26.515730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:26.516881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:26.521924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:26.541848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:26.552839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:26.555080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:26.557098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 298/605] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:47:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:26.568550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:26.612346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:26.613809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:26.716959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:26.795284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff981e-fd3b-42d3-904d-1a06d9b0931d None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:26.835522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 308/606] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:47:26.844343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:26.910590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:26.910590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:26.910590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:26.910590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:26.911082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:26.911082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:26.911924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:26.933312 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 299/607] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:47:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:26.946878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:27.019700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476add3-5b5c-4737-a9c3-192d429c5c46 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:27.062980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdb1d6-7826-4fb8-96c1-63874208ea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:27.063893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdb1d6-7826-4fb8-96c1-63874208ea3c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.064306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdb1d6-7826-4fb8-96c1-63874208ea3c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.064706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdb1d6-7826-4fb8-96c1-63874208ea3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.066129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:27.076868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdb1d6-7826-4fb8-96c1-63874208ea3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:27.078604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdb1d6-7826-4fb8-96c1-63874208ea3c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-2bcdb1d6-7826-4fb8-96c1-63874208ea3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:27.094909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:27.096080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:27.097249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:27.097249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:27.097249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:27.103416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:27.103699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 309/608] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:27.105682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa9d96-4baf-49d0-927f-77611056b925 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.106140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa9d96-4baf-49d0-927f-77611056b925 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.106587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa9d96-4baf-49d0-927f-77611056b925 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.108136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 310/609] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:27.109124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa9d96-4baf-49d0-927f-77611056b925 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:27.127742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01825141-d22c-47b7-9352-1288b4894fd5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:27.196235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebff7d8-3635-4eb2-934f-4f20b10cdd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:27.197523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebff7d8-3635-4eb2-934f-4f20b10cdd53 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.198063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebff7d8-3635-4eb2-934f-4f20b10cdd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.198632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebff7d8-3635-4eb2-934f-4f20b10cdd53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.220645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebff7d8-3635-4eb2-934f-4f20b10cdd53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:27.221016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa9d96-4baf-49d0-927f-77611056b925 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:27.224535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebff7d8-3635-4eb2-934f-4f20b10cdd53 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-bebff7d8-3635-4eb2-934f-4f20b10cdd53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:27.256309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:27.257280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:27.258142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:27.258142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:27.258142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:27.259148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 300/610] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:27.263880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3450e2-9f76-4d2e-bda3-1fd2977e53ad None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.263880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3450e2-9f76-4d2e-bda3-1fd2977e53ad None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.263880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3450e2-9f76-4d2e-bda3-1fd2977e53ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.266338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:27.267173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.267588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.267998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.268821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:27.269258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:27.270806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:27.290478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 311/611] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:27.291809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:27.300127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-8e3450e2-9f76-4d2e-bda3-1fd2977e53ad None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:27.302789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8e3450e2-9f76-4d2e-bda3-1fd2977e53ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:27.364171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:27.410514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ee218-de8a-4eda-aebb-abc3643a00a8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:27.449180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 301/612] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:27.450919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3450e2-9f76-4d2e-bda3-1fd2977e53ad None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:27.451561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9bb6e-34e4-4541-bef8-7526efadf124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:27.452430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bb6e-34e4-4541-bef8-7526efadf124 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.452849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bb6e-34e4-4541-bef8-7526efadf124 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.453263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9bb6e-34e4-4541-bef8-7526efadf124 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.454110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9bb6e-34e4-4541-bef8-7526efadf124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:27.454544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9bb6e-34e4-4541-bef8-7526efadf124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:27.456456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9bb6e-34e4-4541-bef8-7526efadf124 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:27.476563 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 312/613] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:27.477670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2aeec-21af-43e9-bc38-f3dbd109ef95 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.477815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2aeec-21af-43e9-bc38-f3dbd109ef95 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.478476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2aeec-21af-43e9-bc38-f3dbd109ef95 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.480942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 313/614] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:27.482403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2aeec-21af-43e9-bc38-f3dbd109ef95 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:27.546693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:27.612886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2aeec-21af-43e9-bc38-f3dbd109ef95 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:27.640687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:27.667092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3450e2-9f76-4d2e-bda3-1fd2977e53ad None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:27.683932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509c017-4ef3-4b16-918f-c5b22e403243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:27.685040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c017-4ef3-4b16-918f-c5b22e403243 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.685523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c017-4ef3-4b16-918f-c5b22e403243 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.686118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c017-4ef3-4b16-918f-c5b22e403243 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.704945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509c017-4ef3-4b16-918f-c5b22e403243 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:27.707904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509c017-4ef3-4b16-918f-c5b22e403243 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:27.711231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:27.712163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.712824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.713282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.721622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:27.723561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-0509c017-4ef3-4b16-918f-c5b22e403243 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:27.732480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:27.733475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:27.734401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:27.740103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:27.741045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:27.741924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:27.742357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 314/616] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:47:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:27.744829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df44d4-2d81-4692-94fb-bae0c8135a05 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.745321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df44d4-2d81-4692-94fb-bae0c8135a05 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.745807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df44d4-2d81-4692-94fb-bae0c8135a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.746291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 302/616] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:27.747278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:27.774507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-44df44d4-2d81-4692-94fb-bae0c8135a05 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:27.775992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-44df44d4-2d81-4692-94fb-bae0c8135a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:27.870731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 315/617] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:27.872117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df44d4-2d81-4692-94fb-bae0c8135a05 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:27.885918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:27.897773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22150140-b091-4001-a7bf-0e9bef4755da None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:27.963313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:27.964382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:27.964857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:27.965325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:27.966399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:27.969049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:27.993494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:27.994811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 11 11:47:27.995854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:27.996699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 303/618] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 11 11:47:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:27.998606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:28.068216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df44d4-2d81-4692-94fb-bae0c8135a05 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:28.085361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:28.130507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559332b-605a-4199-8b72-aa453c08dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:28.131817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559332b-605a-4199-8b72-aa453c08dd61 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.132253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559332b-605a-4199-8b72-aa453c08dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.132878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559332b-605a-4199-8b72-aa453c08dd61 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.134141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559332b-605a-4199-8b72-aa453c08dd61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:28.134707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559332b-605a-4199-8b72-aa453c08dd61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:28.137203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559332b-605a-4199-8b72-aa453c08dd61 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:28.161475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5b7f-d2ba-41bf-9f02-c4dc108844b9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:28.162184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 316/619] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Oct 11 11:47:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:28.163731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c264-f431-43ad-a9b6-85bfea714b20 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.164136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c264-f431-43ad-a9b6-85bfea714b20 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.164533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c264-f431-43ad-a9b6-85bfea714b20 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.166269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 317/620] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:28.167181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3c264-f431-43ad-a9b6-85bfea714b20 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:28.218782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:28.219750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.220192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.220582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.221585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:28.222069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:28.223877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:28.237974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 304/621] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:28.238847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:28.270537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:28.310066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3c264-f431-43ad-a9b6-85bfea714b20 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:28.356576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a6220-d5ad-41cb-8eb2-007757fd14ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:28.357271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a6220-d5ad-41cb-8eb2-007757fd14ff None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.357547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a6220-d5ad-41cb-8eb2-007757fd14ff None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.357815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a6220-d5ad-41cb-8eb2-007757fd14ff None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.358458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a6220-d5ad-41cb-8eb2-007757fd14ff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:28.358832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a6220-d5ad-41cb-8eb2-007757fd14ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:28.360221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a6220-d5ad-41cb-8eb2-007757fd14ff None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:28.365391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 318/622] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 11 11:47:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:28.366571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57dbf-a9e8-45af-850d-c0dcc63d7961 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.366858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57dbf-a9e8-45af-850d-c0dcc63d7961 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.367204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57dbf-a9e8-45af-850d-c0dcc63d7961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.368724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc1924-7db0-4039-82aa-8310ec673e14 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:28.388449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cbb57dbf-a9e8-45af-850d-c0dcc63d7961 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:28.389557 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cbb57dbf-a9e8-45af-850d-c0dcc63d7961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:28.409550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:28.410192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.410463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.410765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.411425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:28.412815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:28.416775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:28.430059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 305/623] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:47:28 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:28.430949 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:28.498631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 319/624] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:28 2022] POST /identity/v3/auth/tokens => generated 1112 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:28.498631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57dbf-a9e8-45af-850d-c0dcc63d7961 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:28.562273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:28.597772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78056929-aac0-4618-9a77-ae2d2e811abc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:28.640338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57dbf-a9e8-45af-850d-c0dcc63d7961 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:28.668307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:28.669309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.669824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.670272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.709379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:28.710410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:28.710887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:28.711312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:28.712604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=f947cc3d958a49549b74d210453f2ced) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:28.713177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:28.715799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:28.734858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 320/625] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:28 2022] GET /identity/v3/role_assignments?user.id=f947cc3d958a49549b74d210453f2ced&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:28.736398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:28.781503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:28.815001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:28.818682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:28.942909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d04b2-0f46-43a4-8ab4-c01987c0c2af None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:29.009764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:29.017241 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:29.018587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:29.019236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:29.019907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:29.021206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:29.021916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:29.024688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:29.034446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 321/626] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 11 11:47:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:29.036207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:29.058210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 306/627] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:28 2022] GET /identity/v3/auth/tokens => generated 1112 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:47:29.061020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:29.221386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:29.257655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e03193-6193-458c-ac54-cb3699dd89c5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:29.299285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b1ec3-311a-4b3c-b3e3-974675559970 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:29.333081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:29.334422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:29.335008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:29.335472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:29.337093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:29.339777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:29.360439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:29.362515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:29.364127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 322/628] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:29 2022] GET /identity/v3/services/network => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:29.365634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:29.376021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:29.377565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:29.378298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:29.379101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:29.380839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:29.383817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:29.429777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 307/629] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:47:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:29.432244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:29.531711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:29.685121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356c8f9-748b-48f2-8df7-2cfc13042599 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:29.693993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0dbd9-1814-44f9-9a53-aad1dcad5fc4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:29.808306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:29.809252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:29.809450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:29.809831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:29.810305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:29.810463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:29.810826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:29.811261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:29.811811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] RBAC: Adding query filter params (name=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:29.814655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:29.815385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:29.829604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 308/630] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:29.836007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:29.839278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:29.841991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:29.875022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:29.882004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:29.884022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:29.885046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:29.885046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:29.885046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:29.885046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 323/631] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 522 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:29.894465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:30.039292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:30.055889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c4cbf-dea0-4a0e-8f82-ee0753c3d306 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:30.172408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e44ff-3934-486b-8920-6d176209cd9e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:30.187737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:30.189085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:30.189751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:30.190421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:30.191551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] RBAC: Adding query filter params (type=network) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:30.192070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:30.194518 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:30.222596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 309/632] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:30.230698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:30.258424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:30.260465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:30.261190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:30.261883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:30.263358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:30.264135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:30.267538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:30.301256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 324/633] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:30.309554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:30.506787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:30.522465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f11fc9-b808-487b-b1d8-53a9d4f05884 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:30.634670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0b18f-4d02-4172-a09f-e5ffc660e762 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:30.639890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:30.646593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:30.646593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:30.646593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:30.646593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:30.646593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:30.683625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 310/634] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:47:30 2022] POST /identity/v3/endpoints => generated 337 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:47:30.758521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:30.759109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:30.759384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:30.759710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:30.772238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:30.773855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:30.789937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:30.791737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:30.795313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 325/635] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 483 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:30.807042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:30.864735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:31.066846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f133e-ec3a-4ea1-8555-9540f0015b76 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:31.147139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166532d-d358-44a0-96ad-959aa083f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:31.148693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166532d-d358-44a0-96ad-959aa083f5cd None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:31.149432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166532d-d358-44a0-96ad-959aa083f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:31.150254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166532d-d358-44a0-96ad-959aa083f5cd None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:31.151911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166532d-d358-44a0-96ad-959aa083f5cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:31.152787 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166532d-d358-44a0-96ad-959aa083f5cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:31.155892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166532d-d358-44a0-96ad-959aa083f5cd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:31.187993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 311/636] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:31.198523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:31.422011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd9802-9cbe-4814-ba13-b78751a4792c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:31.454111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:31.487716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee5e47-1d7d-41e1-bbfa-9b64e873eb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:31.488763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee5e47-1d7d-41e1-bbfa-9b64e873eb11 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:31.489243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee5e47-1d7d-41e1-bbfa-9b64e873eb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:31.489720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee5e47-1d7d-41e1-bbfa-9b64e873eb11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:31.491161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee5e47-1d7d-41e1-bbfa-9b64e873eb11 None admin] RBAC: Adding query filter params (role.id=e72e1826d36c4a618d9bb4023d8acd93, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=3acdcbc6be244b96a620a6e5ec894f0f) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:31.491697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee5e47-1d7d-41e1-bbfa-9b64e873eb11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:31.494544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee5e47-1d7d-41e1-bbfa-9b64e873eb11 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:31.506925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 326/637] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:31 2022] GET /identity/v3/role_assignments?user.id=3acdcbc6be244b96a620a6e5ec894f0f&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=e72e1826d36c4a618d9bb4023d8acd93 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:31.788273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3434fd-eae3-485f-980f-44fd981aa04d None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:31.789590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3434fd-eae3-485f-980f-44fd981aa04d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:31.790386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3434fd-eae3-485f-980f-44fd981aa04d None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:31.794242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 312/638] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:31.804189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3210bd-a42f-44b1-a6c2-17d6a66e46db None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:31.804653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3210bd-a42f-44b1-a6c2-17d6a66e46db None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:31.805136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3210bd-a42f-44b1-a6c2-17d6a66e46db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:31.840941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5a3210bd-a42f-44b1-a6c2-17d6a66e46db None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:31.843047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5a3210bd-a42f-44b1-a6c2-17d6a66e46db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:31.977556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 327/639] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:31 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:32.406972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeab4b-0e98-4531-afd4-a728d0760682 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:32.408451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeab4b-0e98-4531-afd4-a728d0760682 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:32.409124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeab4b-0e98-4531-afd4-a728d0760682 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:32.412067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 313/640] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:32.418189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310f512-95d6-4a10-a946-041cde317627 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:32.418608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310f512-95d6-4a10-a946-041cde317627 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:32.418776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310f512-95d6-4a10-a946-041cde317627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:32.439566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a310f512-95d6-4a10-a946-041cde317627 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:32.440766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a310f512-95d6-4a10-a946-041cde317627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:32.473776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeab4b-0e98-4531-afd4-a728d0760682 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:32.572743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 328/641] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:32 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:32.583395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78845-5f2a-419e-bf8e-c7c37f364eca None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:32.583917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78845-5f2a-419e-bf8e-c7c37f364eca None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:32.584334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78845-5f2a-419e-bf8e-c7c37f364eca None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:32.590394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 329/642] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:32.592726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ccd2-fa78-4a07-92da-02c7de6d46fe None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:32.593318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ccd2-fa78-4a07-92da-02c7de6d46fe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:32.593798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4ccd2-fa78-4a07-92da-02c7de6d46fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:32.625186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-18e4ccd2-fa78-4a07-92da-02c7de6d46fe None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:32.628821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-18e4ccd2-fa78-4a07-92da-02c7de6d46fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:32.637292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:32.669396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeab4b-0e98-4531-afd4-a728d0760682 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:32.712623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:32.712881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:32.714196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:32.714674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:32.715109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:32.716805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:32.718488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:32.728944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:32.730276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:32.731651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:32.736346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 314/643] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 11 11:47:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:32.737841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:32.785763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 330/644] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:32 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:32.843074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ccd2-fa78-4a07-92da-02c7de6d46fe None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:32.860367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182634cc-cfa3-4531-b78a-52c5a4008316 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:32.898759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:32.899389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:32.899664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:32.899929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:32.900624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:32.900923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:32.902535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:32.913084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 315/645] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:32.914597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:32.927549 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:32.986474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4ccd2-fa78-4a07-92da-02c7de6d46fe None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.033152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.034506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.035000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.035911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.036703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.038578 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:33.049961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:33.051056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:33.051863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:33.053639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 331/646] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:33.055294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:33.094687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:33.109264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c296023-4906-4f15-886f-55c172f6cad3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.148466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.149113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.149389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.149651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.150363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:33.150699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.152148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.163111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 316/647] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:33.163111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:33.212444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6f68b-4989-4255-b441-21158e5dc601 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.257791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:33.260194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.261225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.261502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.261764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.262370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.263833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:33.273801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:33.274963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:33.275838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 332/648] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:33.279573 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:33.311542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158dfda-826c-4afa-925f-a312f5d1d767 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.352904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.353607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.353879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.354219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.354844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:33.355142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.356584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.367131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 317/649] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:33.368145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:33.430347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:33.436533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d9509-6a5c-4309-b7bc-50c0f00410c5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.481843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.482884 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.482884 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.483137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.483791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] RBAC: Adding query filter params (interface=public, service_id=c5c6db1c7d27483f96304339ca784688, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:33.484095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.485722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.497415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 333/650] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:47:33 2022] GET /identity/v3/endpoints?service_id=c5c6db1c7d27483f96304339ca784688&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:33.497415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:33.514587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f903c-66a2-4bf2-81d4-8be5e8d7cb12 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.582198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.583273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.583753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.584188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.585378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:33.585886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.588678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.590841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:33.607896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 318/651] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:33.609221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:33.659652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f3dbc-fdb2-4d78-872b-77e53419196b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.716408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.717636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.718287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.718949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.720348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:33.720856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.724580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.742685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 334/652] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:33.742685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:33.779983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92c023-f0ba-4758-8225-098978c7ce00 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:33.795012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:33.846897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e393d32-c517-4fe4-a279-8853aa2719f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:33.847944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393d32-c517-4fe4-a279-8853aa2719f9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:33.848516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393d32-c517-4fe4-a279-8853aa2719f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:33.849008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393d32-c517-4fe4-a279-8853aa2719f9 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:33.850119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e393d32-c517-4fe4-a279-8853aa2719f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:33.852756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e393d32-c517-4fe4-a279-8853aa2719f9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:33.863853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 319/653] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:33 2022] GET /identity/v3/services => generated 1029 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:47:33.939978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c9550-7c19-4b4d-82f6-0672693b50cf None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:34.017511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb034bf-1616-4cf2-8aaa-75a481f6a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:34.018443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb034bf-1616-4cf2-8aaa-75a481f6a61c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:34.018962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb034bf-1616-4cf2-8aaa-75a481f6a61c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:34.019438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb034bf-1616-4cf2-8aaa-75a481f6a61c None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:34.020739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb034bf-1616-4cf2-8aaa-75a481f6a61c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:34.021277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb034bf-1616-4cf2-8aaa-75a481f6a61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:34.023972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb034bf-1616-4cf2-8aaa-75a481f6a61c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:34.033994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 335/654] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:34.503857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1a6e-6a03-41c0-ab2e-98116fa42394 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:34.504374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1a6e-6a03-41c0-ab2e-98116fa42394 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:34.504374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1a6e-6a03-41c0-ab2e-98116fa42394 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:34.506067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 320/655] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:47:34.512105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6202-b37f-4248-8250-40f72583790b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:34.513051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6202-b37f-4248-8250-40f72583790b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:34.513051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc6202-b37f-4248-8250-40f72583790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:34.534020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-63dc6202-b37f-4248-8250-40f72583790b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:34.537255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-63dc6202-b37f-4248-8250-40f72583790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:34.656694 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 336/656] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:34 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:34.925206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1a6e-6a03-41c0-ab2e-98116fa42394 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:35.024542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:35.099206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1a6e-6a03-41c0-ab2e-98116fa42394 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:35.165384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:35.166687 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:35.167240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:35.168043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:35.188402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:35.198919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:35.200655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:35.202276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 321/657] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 11 11:47:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:35.207041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6202-b37f-4248-8250-40f72583790b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:35.230407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:35.322973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc6202-b37f-4248-8250-40f72583790b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:35.383985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:35.385043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:35.385489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:35.385924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:35.387155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:35.387689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:35.389976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:35.406779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 337/658] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Oct 11 11:47:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:35.412523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:35.595218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a893a-9bdf-4343-971e-36e1a948d0fc None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:35.637519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:35.659550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:35.660575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:35.661023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:35.661471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:35.684751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:35.687786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:35.718770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:35.720587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:35.722657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:35.722657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:35.722657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:35.722657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 322/659] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:35.728409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:35.871354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:35.904238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bf77-b3e3-4a64-8769-f884bf716a46 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:35.966546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:35.968104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:35.968877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:35.969626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:35.971091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:35.971975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:35.974478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:36.001138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 338/660] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:36.004723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:36.201762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714a20e-7918-46c0-94b9-e952399227a3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:36.244483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:36.245132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:36.245394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:36.245658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:36.254162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:36.255672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:36.268376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:36.270137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:36.272022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 323/661] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:47:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:36.276298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:36.423950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9b193-750c-4825-a6a6-3f85ec8119f6 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:36.467948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c4774-65ad-4d64-b081-1435031eca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:36.469005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4774-65ad-4d64-b081-1435031eca26 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:36.469667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4774-65ad-4d64-b081-1435031eca26 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:36.470347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c4774-65ad-4d64-b081-1435031eca26 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:36.472285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4774-65ad-4d64-b081-1435031eca26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:36.473105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4774-65ad-4d64-b081-1435031eca26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:36.476160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c4774-65ad-4d64-b081-1435031eca26 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:36.502986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:36.511502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 339/662] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Oct 11 11:47:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:36.521075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:36.572829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:36.583337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382b3f-efa0-499b-bca0-e9905b536b28 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:36.584304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382b3f-efa0-499b-bca0-e9905b536b28 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:36.585954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382b3f-efa0-499b-bca0-e9905b536b28 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:36.590703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 340/663] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:36.603801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6681-04aa-406b-bc77-b2e183dd308c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:36.604619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6681-04aa-406b-bc77-b2e183dd308c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:36.605468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6681-04aa-406b-bc77-b2e183dd308c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:36.644314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5c4c6681-04aa-406b-bc77-b2e183dd308c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:36.648028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5c4c6681-04aa-406b-bc77-b2e183dd308c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:36.670073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2119a-a04f-4a54-bba9-48dec4821c82 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:36.726598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:36.727673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:36.728371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:36.728828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:36.741432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:36.743424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:36.761360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:36.762362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:36.763252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:36.763252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:36.763252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:36.771957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 341/664] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:36 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:36.772502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 324/665] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:36.776395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6681-04aa-406b-bc77-b2e183dd308c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:36.948669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6681-04aa-406b-bc77-b2e183dd308c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:37.012970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:37.020457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:37.021496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.021963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.022421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.023633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:37.024160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:37.026900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:37.048242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:37.051485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 342/666] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:37.059736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:37.225086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bdfc36-d79d-4891-b326-617054a84fa0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:37.255760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:37.286740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3049-a3c3-4085-9258-88e7b0516dda None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:37.291022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f7008-abe0-4ddd-a2a8-a2f431e419a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:37.292094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7008-abe0-4ddd-a2a8-a2f431e419a0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.292554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7008-abe0-4ddd-a2a8-a2f431e419a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.293375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7008-abe0-4ddd-a2a8-a2f431e419a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.305378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f7008-abe0-4ddd-a2a8-a2f431e419a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:37.308175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f7008-abe0-4ddd-a2a8-a2f431e419a0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f36f7008-abe0-4ddd-a2a8-a2f431e419a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:37.326877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:37.328644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:37.329907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 343/667] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:37.331499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabdf49-e138-4764-b540-29a758a05141 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.331975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabdf49-e138-4764-b540-29a758a05141 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.332435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabdf49-e138-4764-b540-29a758a05141 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.334948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 344/668] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:37.336820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18df3e9-fa2f-4734-bbed-6133961a29da None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.337112 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18df3e9-fa2f-4734-bbed-6133961a29da None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.337348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371e3f2-b3b3-49ec-82fa-65f04bab8533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:37.337676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18df3e9-fa2f-4734-bbed-6133961a29da None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.338176 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371e3f2-b3b3-49ec-82fa-65f04bab8533 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.338655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371e3f2-b3b3-49ec-82fa-65f04bab8533 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.339296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371e3f2-b3b3-49ec-82fa-65f04bab8533 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.340017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371e3f2-b3b3-49ec-82fa-65f04bab8533 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:37.340317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 345/669] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:37.341656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18df3e9-fa2f-4734-bbed-6133961a29da None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:37.341925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371e3f2-b3b3-49ec-82fa-65f04bab8533 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:37.360807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 325/670] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:47:37 2022] POST /identity/v3/services => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:47:37.362389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607541be-2b6a-49fd-9801-020587306659 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.362835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607541be-2b6a-49fd-9801-020587306659 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.363279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607541be-2b6a-49fd-9801-020587306659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.388001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-607541be-2b6a-49fd-9801-020587306659 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:37.389750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-607541be-2b6a-49fd-9801-020587306659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:37.428103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:37.511876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 326/671] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:37.513654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471e0b-0f65-4bf9-ab7c-8194417174aa None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.514154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471e0b-0f65-4bf9-ab7c-8194417174aa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.514793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0471e0b-0f65-4bf9-ab7c-8194417174aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.531047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18df3e9-fa2f-4734-bbed-6133961a29da None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:37.556472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d0471e0b-0f65-4bf9-ab7c-8194417174aa None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:37.559526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d0471e0b-0f65-4bf9-ab7c-8194417174aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:37.598697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:37.599787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.600305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.602599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.602599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:37.602599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:37.605284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:37.629866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 346/672] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:37.640116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:37.708512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 327/673] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:37.841535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc3692-6a4d-46ca-aeaf-e2b6dbedc7cb None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:37.845032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0471e0b-0f65-4bf9-ab7c-8194417174aa None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:37.866432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:37.871034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:37.914602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:37.915691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:37.916149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:37.916606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/3acdcbc6be244b96a620a6e5ec894f0f/roles/32716052f3054ba4b5d57af19c157f1a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:37.920494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=3acdcbc6be244b96a620a6e5ec894f0f, role_id=32716052f3054ba4b5d57af19c157f1a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:37.923224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:37.949168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 347/674] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:47:37 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/3acdcbc6be244b96a620a6e5ec894f0f/roles/32716052f3054ba4b5d57af19c157f1a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:47:37.980936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:38.064607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0471e0b-0f65-4bf9-ab7c-8194417174aa None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:38.109546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:38.110075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:38.110343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:38.110642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:38.111313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:38.113068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:38.138587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 328/675] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:47:37 2022] POST /identity/v3/services => generated 241 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:47:38.151399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db67f09-899d-4de9-83bf-cf44f006ec5b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:38.212907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:38.214081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:38.214581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:38.215160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:38.216320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:38.219095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:38.237510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:38.238621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 11 11:47:38.239543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:38.240265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 348/676] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 11 11:47:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:38.247035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:38.362777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:38.443767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bcb45-bee0-431f-ac21-33b252c03d74 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:38.506924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:38.507932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:38.508989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:38.508989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:38.509615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:38.509914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:38.511352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:38.518855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 329/677] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:38.528025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:38.562786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:38.720085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe9c6-0d83-4659-aae9-1cf12aff4d36 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:38.790161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b214d5-de3a-4d48-a744-5a19ce9f7f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:38.791701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b214d5-de3a-4d48-a744-5a19ce9f7f9e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:38.793017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b214d5-de3a-4d48-a744-5a19ce9f7f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:38.793645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b214d5-de3a-4d48-a744-5a19ce9f7f9e None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:38.794979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b214d5-de3a-4d48-a744-5a19ce9f7f9e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:38.795648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b214d5-de3a-4d48-a744-5a19ce9f7f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:38.798439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b214d5-de3a-4d48-a744-5a19ce9f7f9e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:38.808902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 349/678] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:38.818007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:39.011376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1644993-057a-4c3c-b083-d05b97e90387 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:39.058576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:39.073888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae55d7-9839-4ea5-8e76-491337c9fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:39.074925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae55d7-9839-4ea5-8e76-491337c9fcf0 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:39.075337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae55d7-9839-4ea5-8e76-491337c9fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:39.075797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae55d7-9839-4ea5-8e76-491337c9fcf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:39.077109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae55d7-9839-4ea5-8e76-491337c9fcf0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:39.079684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae55d7-9839-4ea5-8e76-491337c9fcf0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:39.117969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 330/679] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:47:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:40.029793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b92754-5b88-43c4-a71b-4a8aad86779e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:40.030312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b92754-5b88-43c4-a71b-4a8aad86779e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:40.030312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b92754-5b88-43c4-a71b-4a8aad86779e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:40.031996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 350/680] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:40.038148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374a1f7-7e20-4f2e-b801-89845a181ddb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:40.038467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374a1f7-7e20-4f2e-b801-89845a181ddb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:40.038721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374a1f7-7e20-4f2e-b801-89845a181ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:40.059629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d374a1f7-7e20-4f2e-b801-89845a181ddb None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:40.060861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d374a1f7-7e20-4f2e-b801-89845a181ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:40.150672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 331/681] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:40.412408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b92754-5b88-43c4-a71b-4a8aad86779e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:40.529887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:40.548116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b92754-5b88-43c4-a71b-4a8aad86779e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:40.615959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:40.617495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:40.618247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:40.619009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:40.620367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:40.623240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:40.641166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:40.643075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:40.644736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:40.649654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 351/682] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:40.659287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374a1f7-7e20-4f2e-b801-89845a181ddb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:40.799603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374a1f7-7e20-4f2e-b801-89845a181ddb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:40.818650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:40.866341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:40.867443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:40.867929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:40.868423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:40.869653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:40.870198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:40.872845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:40.882785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 332/683] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:40.891763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:41.074645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd7c8-5b74-4aec-938b-49e1f65ca02a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:41.117246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd941f-6159-41ec-95eb-12ca78ac178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:41.117927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd941f-6159-41ec-95eb-12ca78ac178e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.118213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd941f-6159-41ec-95eb-12ca78ac178e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.118484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd941f-6159-41ec-95eb-12ca78ac178e None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.119273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd941f-6159-41ec-95eb-12ca78ac178e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:41.119574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd941f-6159-41ec-95eb-12ca78ac178e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:41.121068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd941f-6159-41ec-95eb-12ca78ac178e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:41.127636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 352/684] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:41.134293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:41.321195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5f35-d967-471c-a20c-eefe009c6912 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:41.373406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122c53-a51c-425a-a04d-8ca91b2ab5cb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.374062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122c53-a51c-425a-a04d-8ca91b2ab5cb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.374632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122c53-a51c-425a-a04d-8ca91b2ab5cb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.380984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 353/685] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:47:41.383514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e43f3-7306-4002-8a14-82e7df8dd36c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.384083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e43f3-7306-4002-8a14-82e7df8dd36c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.384632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e43f3-7306-4002-8a14-82e7df8dd36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.388268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:41.389326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.389910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.390401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.391809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] RBAC: Adding query filter params (interface=public, service_id=4ed0b57fdb894ba29405802e65473bd6, region_id=RegionOne) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:41.392372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:41.395082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:41.406074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 333/686] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:47:41 2022] GET /identity/v3/endpoints?service_id=4ed0b57fdb894ba29405802e65473bd6&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:41.407356 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f15e43f3-7306-4002-8a14-82e7df8dd36c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:41.408793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f15e43f3-7306-4002-8a14-82e7df8dd36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:41.415696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:41.430003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:41.490124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 354/687] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:41.499693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:41.506985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5f42-3f9b-4b0a-adcf-6db4c9ab7bec None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.507280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5f42-3f9b-4b0a-adcf-6db4c9ab7bec None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.507524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5f42-3f9b-4b0a-adcf-6db4c9ab7bec None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.509150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 355/688] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:41.515161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5802e-2827-432d-b4b6-947164e558e1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.515446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5802e-2827-432d-b4b6-947164e558e1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.515703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5802e-2827-432d-b4b6-947164e558e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.536720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6bf5802e-2827-432d-b4b6-947164e558e1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:41.538007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6bf5802e-2827-432d-b4b6-947164e558e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:41.604236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a9d3e-e6ef-480d-8539-074a3537ffe8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:41.619138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 356/689] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:41.665654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af505939-632e-41eb-ac94-2d540fad172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:41.666798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505939-632e-41eb-ac94-2d540fad172c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.667286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505939-632e-41eb-ac94-2d540fad172c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.668060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af505939-632e-41eb-ac94-2d540fad172c None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.669160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af505939-632e-41eb-ac94-2d540fad172c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:41.671850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af505939-632e-41eb-ac94-2d540fad172c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:41.685569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 334/690] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:41 2022] GET /identity/v3/services => generated 1497 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:47:41.772932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5802e-2827-432d-b4b6-947164e558e1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:41.874935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:41.882533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8f848-cd30-4751-ba0f-11559fa5e41a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.883043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8f848-cd30-4751-ba0f-11559fa5e41a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.883520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8f848-cd30-4751-ba0f-11559fa5e41a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.886137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 335/691] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:41.896987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4768f9-a55d-44de-b704-d78451ce80ea None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.897637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4768f9-a55d-44de-b704-d78451ce80ea None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.898367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4768f9-a55d-44de-b704-d78451ce80ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:41.911988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5802e-2827-432d-b4b6-947164e558e1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:41.932806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4d4768f9-a55d-44de-b704-d78451ce80ea None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:41.934057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d4768f9-a55d-44de-b704-d78451ce80ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:41.977018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:41.978704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:41.978704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:41.979194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.003764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:42.008999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:42.011011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 357/692] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 11 11:47:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:42.012625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.036602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 336/693] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:42.037478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4768f9-a55d-44de-b704-d78451ce80ea None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.088326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:42.184932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d5fee-5069-467e-b461-32eb69c308aa None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.199325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4768f9-a55d-44de-b704-d78451ce80ea None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.226916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:42.227570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:42.227838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:42.228220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.228736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:42.230248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:42.241197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:42.243089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:42.244785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 358/694] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:42.252140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.267123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:42.284342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:42.285869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:42.286641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:42.288272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.290134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:42.291295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:42.294154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:42.314665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 337/695] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:42.320385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.427805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:42.437583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db1f0-f9e0-4bed-a507-028b7001667d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.448979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27d1f9-c5d1-4f8c-9eff-9fa82175121b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.489464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:42.491404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:42.492316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:42.492975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.494425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:42.494763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:42.495229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:42.495562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:42.495888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.496106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:42.499198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:42.506193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 359/696] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:42.508990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:42.514669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:42.515103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:42.536319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:42.537496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:42.538585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:42.538585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:42.538585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:42.540821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 338/697] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:42.547788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.632478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:42.691282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c270e3a-28f5-4b02-92fe-3ddeb7f1cb23 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.694226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ec300-8b32-43c2-a088-e38f49d133f6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.744328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:42.745460 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:42.745954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:42.746426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.746759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:42.747530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:42.747714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:42.748061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:42.748228 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:42.748481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.749236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:42.749658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:42.750655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:42.751410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:42.764124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 360/698] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:42.764124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.780840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 339/699] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:42.780840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:42.785462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:42.926911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495cdc8-f0a8-4da6-a65f-c9066bc67337 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.937517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be444-b5b1-4300-9701-025da1fe9b91 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:42.969914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:42.970452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:42.970737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:42.971016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:42.971758 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] RBAC: Adding query filter params (interface=public, service_id=bf57ef6cc5df45289e5b747ac7206497, region_id=RegionOne) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:42.972058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:42.973457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:42.984899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 340/700] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/endpoints?service_id=bf57ef6cc5df45289e5b747ac7206497&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:42.990920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:43.013295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:43.014718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:43.015166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:43.015608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:43.016594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:43.019063 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:43.022252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:43.036930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:43.038100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:43.039023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 361/701] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:43.041165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:43.106612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:43.165884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2c918-5352-4f8e-b108-e2d02bf05be0 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:43.222317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee06a92-da26-433e-a836-17997335a970 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:43.227587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:43.228669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:43.229107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:43.229536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:43.242794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:43.245279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:43.266442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:43.268288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 341/702] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:47:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:43.271242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:43.299095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:43.299826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:43.300217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:43.300600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:43.301593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:43.303884 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:43.326593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 362/703] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:43 2022] GET /identity/v3/services => generated 1497 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:47:43.326593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:43.443177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:43.464742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065ecb9-facf-4417-800b-445150ab2867 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:43.515196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:43.532771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:43.533510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a70c6-8e79-4a24-a071-7dbc00e273f4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:43.534186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:43.534728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:43.535245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:43.536524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:43.537096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:43.541764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:43.551951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 342/704] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:43.560763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:43.604405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:43.605735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:43.606611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:43.607289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:43.609033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:43.609843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:43.612716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:43.647724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 363/705] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Oct 11 11:47:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:43.658714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:43.748444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b4ba9-4fd9-43e7-ab2d-841edf9f9a26 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:43.812759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:43.814310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:43.815143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:43.815900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:43.817355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:43.818154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:43.821202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:43.831177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 343/706] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:43.862389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49424c-bd96-4ecc-9b18-dd1b7bc29f2c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:43.900187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:43.924021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7da8d-8344-4c76-94f5-60b13cd0bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:43.924953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7da8d-8344-4c76-94f5-60b13cd0bd7d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:43.925373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7da8d-8344-4c76-94f5-60b13cd0bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:43.925795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7da8d-8344-4c76-94f5-60b13cd0bd7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:44.056540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7da8d-8344-4c76-94f5-60b13cd0bd7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:44.059133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7da8d-8344-4c76-94f5-60b13cd0bd7d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:44.240200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 364/707] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:47:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:47:44.249064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:44.265925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7044-a3e7-4478-add8-c592256d37a9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:44.266809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7044-a3e7-4478-add8-c592256d37a9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:44.267516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7044-a3e7-4478-add8-c592256d37a9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:44.271356 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 365/708] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:44.277466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4b593-c6bc-4db8-af67-81d8322a873a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:44.277732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4b593-c6bc-4db8-af67-81d8322a873a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:44.278029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4b593-c6bc-4db8-af67-81d8322a873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:44.299728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-94f4b593-c6bc-4db8-af67-81d8322a873a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:44.301005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-94f4b593-c6bc-4db8-af67-81d8322a873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:44.322399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:44.394891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 366/709] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:44.400806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:44.490039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fbc48-7e93-4ae5-8369-149a742904ce None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:44.556728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:44.558106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:44.558807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:44.559496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:44.582100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:44.585436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:44.615114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:44.617166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:44.619229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:44.619229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:44.619229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:44.622333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 344/710] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:44.629516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4b593-c6bc-4db8-af67-81d8322a873a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:44.667374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:44.854035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877ee84-1cd2-4f44-9384-a0cc01d98b98 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:44.867938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4b593-c6bc-4db8-af67-81d8322a873a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:44.874823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:44.930999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:44.931933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:44.932385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:44.932707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:44.932935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:44.933931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:44.934370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:44.934539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:44.935215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:44.935807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:44.936970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:44.937146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:44.940131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:44.959275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:44.961447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 11 11:47:44.963415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:44.965238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 367/711] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:44.967726 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 345/712] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:44.967939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:44.978795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:44.995766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:45.130099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3bdfa-7716-4b96-9968-40dbfdb33f38 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:45.186061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513df7e-4a3e-484f-832b-f14db7b82f96 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:45.195811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:45.196814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:45.197330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:45.197762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:45.198832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:45.199310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:45.201624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:45.210806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 346/713] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:45.219806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:45.245729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:45.247160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:45.247693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:45.248226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:45.256987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:45.259106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:45.272456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:45.273422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:45.274305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:45.276622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 368/714] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:45.286291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:45.367412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5da12-584b-4b36-a7b3-ac0529adf5f5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:45.371036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:45.406621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:45.407320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:45.407687 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:45.408050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:45.408908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:45.409294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:45.410821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:45.421572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 347/715] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 11 11:47:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:45.423041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:45.428906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:45.477409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437958a-4347-410f-b374-ef034f961c06 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:45.540663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5769ffc-7517-4b1b-8083-946891552f0e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:45.542853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:45.546048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:45.547881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:45.549001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:45.549718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:45.551438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:45.552466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:45.554943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:45.575210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 369/716] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:47:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:45.588084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:45.588330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f855e6-8b8b-4b1c-8726-40b2b9e15c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:45.588330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f855e6-8b8b-4b1c-8726-40b2b9e15c50 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:45.588330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f855e6-8b8b-4b1c-8726-40b2b9e15c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:45.588330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f855e6-8b8b-4b1c-8726-40b2b9e15c50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:45.588906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f855e6-8b8b-4b1c-8726-40b2b9e15c50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:45.588906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f855e6-8b8b-4b1c-8726-40b2b9e15c50 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:45.618766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 348/717] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:47:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:45.794761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404616-46ef-4b8c-957b-507e1f027f65 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:45.850734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:45.867593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d1bee-6f81-4cb7-82cb-255650f43433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:45.868214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d1bee-6f81-4cb7-82cb-255650f43433 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:45.868531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d1bee-6f81-4cb7-82cb-255650f43433 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:45.868797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d1bee-6f81-4cb7-82cb-255650f43433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:45.869529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d1bee-6f81-4cb7-82cb-255650f43433 None admin] RBAC: Adding query filter params (role.id=32716052f3054ba4b5d57af19c157f1a, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=3acdcbc6be244b96a620a6e5ec894f0f) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:45.869841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d1bee-6f81-4cb7-82cb-255650f43433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:45.873069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d1bee-6f81-4cb7-82cb-255650f43433 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:45.880647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 370/718] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:47:45 2022] GET /identity/v3/role_assignments?user.id=3acdcbc6be244b96a620a6e5ec894f0f&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=32716052f3054ba4b5d57af19c157f1a => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:47.153373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39ede-82de-42c8-bc16-e385239e36f1 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:47.153935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39ede-82de-42c8-bc16-e385239e36f1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:47.157024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c39ede-82de-42c8-bc16-e385239e36f1 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:47.157024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 349/719] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:47.167156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa244aa-7b49-4830-9f4d-0be33faa1c5a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:47.168908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa244aa-7b49-4830-9f4d-0be33faa1c5a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:47.169712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa244aa-7b49-4830-9f4d-0be33faa1c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:47.200764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7aa244aa-7b49-4830-9f4d-0be33faa1c5a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:47.201930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7aa244aa-7b49-4830-9f4d-0be33faa1c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:47.281467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 371/720] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:47.392047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262190-b8b4-48a9-9241-12f7c8c975a2 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:47.392998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262190-b8b4-48a9-9241-12f7c8c975a2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:47.393743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58262190-b8b4-48a9-9241-12f7c8c975a2 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:47.396904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 350/721] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:47.405446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8a47-92c1-4e12-8ebf-c952e9068127 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:47.405939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8a47-92c1-4e12-8ebf-c952e9068127 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:47.406401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8a47-92c1-4e12-8ebf-c952e9068127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:47.433217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-404d8a47-92c1-4e12-8ebf-c952e9068127 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:47.434396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-404d8a47-92c1-4e12-8ebf-c952e9068127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:47.505050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 372/722] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:47.789963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262190-b8b4-48a9-9241-12f7c8c975a2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:47.973115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58262190-b8b4-48a9-9241-12f7c8c975a2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:48.016125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d8a47-92c1-4e12-8ebf-c952e9068127 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:48.045623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:48.047224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.047993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.048728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.050293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:48.053310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:48.072070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:48.073976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:48.075621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:48.086620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 351/723] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:48.092096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:48.108672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:48.134224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:48.185973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d8a47-92c1-4e12-8ebf-c952e9068127 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:48.244571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c7350-07df-46c6-b88d-2145d168a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:48.245443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c7350-07df-46c6-b88d-2145d168a3a9 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.245858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c7350-07df-46c6-b88d-2145d168a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.246270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c7350-07df-46c6-b88d-2145d168a3a9 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.247394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c7350-07df-46c6-b88d-2145d168a3a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:48.249205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c7350-07df-46c6-b88d-2145d168a3a9 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:48.274796 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 373/724] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:47:48 2022] POST /identity/v3/services => generated 242 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:48.274796 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51617ea-eab5-4f36-9573-d639b6bd84b7 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.274796 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51617ea-eab5-4f36-9573-d639b6bd84b7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.275689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51617ea-eab5-4f36-9573-d639b6bd84b7 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.277012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 374/725] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:48.283092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1188c-ff1e-4646-b163-a57d56956c7b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.283493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1188c-ff1e-4646-b163-a57d56956c7b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.283680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1188c-ff1e-4646-b163-a57d56956c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.300335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08009841-dcb5-4112-9060-f6988883cc1a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:48.304931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8ea1188c-ff1e-4646-b163-a57d56956c7b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:48.306347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8ea1188c-ff1e-4646-b163-a57d56956c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:48.378994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e230948-7e2f-4f43-bd54-85a6c9b9e8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:48.379636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230948-7e2f-4f43-bd54-85a6c9b9e8ab None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.381278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230948-7e2f-4f43-bd54-85a6c9b9e8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.381278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230948-7e2f-4f43-bd54-85a6c9b9e8ab None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.381278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e230948-7e2f-4f43-bd54-85a6c9b9e8ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:48.381278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e230948-7e2f-4f43-bd54-85a6c9b9e8ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:48.382671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e230948-7e2f-4f43-bd54-85a6c9b9e8ab None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:48.392589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 352/726] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:48.392589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9271f-0201-49b2-8b02-9159a00b0427 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.392589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9271f-0201-49b2-8b02-9159a00b0427 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.392589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9271f-0201-49b2-8b02-9159a00b0427 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.392589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 353/727] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:48.398291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c5430-a283-460b-9b35-c796e2248ea0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.398590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c5430-a283-460b-9b35-c796e2248ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.398847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c5430-a283-460b-9b35-c796e2248ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.419729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-307c5430-a283-460b-9b35-c796e2248ea0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:48.420986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-307c5430-a283-460b-9b35-c796e2248ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:48.454467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 375/728] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:48.455345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1188c-ff1e-4646-b163-a57d56956c7b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:48.511058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 354/729] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:48.535009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:48.615517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1188c-ff1e-4646-b163-a57d56956c7b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:48.657948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:48.658599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.658879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.659139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.659802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:48.660172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:48.661592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:48.668522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 376/730] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:48.677475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c5430-a283-460b-9b35-c796e2248ea0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:48.693723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:48.731804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:48.832087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c5430-a283-460b-9b35-c796e2248ea0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:48.886150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:48.886150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:48.886150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:48.886779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:48.887252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:48.889915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:48.903051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2848dc4-4d9d-46ee-b9c0-603e1e982e16 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:48.908233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:48.919081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 355/731] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:47:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:48.924329 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:49.003953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:49.005033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:49.005484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:49.005940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:49.007345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:49.010117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:49.015049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING keystone.server.flask.common [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 11 11:47:49.054672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.sql.core [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 11:47:49.054672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 11:47:49.054672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [parameters: {'id': '1285bf0649264da884d505e03edd397d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 11 11:47:49.054672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81390) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 11:47:49.074939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1285bf0649264da884d505e03edd397d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1285bf0649264da884d505e03edd397d. Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:47:49.075399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 11:47:49.076830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application yield resource Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise self.value Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application session.commit() Oct 11 11:47:49.079372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.session.flush() Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application compat.raise_( Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 11:47:49.082262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 11:47:49.085923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application result.read() Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:47:49.089399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [parameters: {'id': '1285bf0649264da884d505e03edd397d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:49.094528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:49.099142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1285bf0649264da884d505e03edd397d. Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 377/732] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Oct 11 11:47:48 2022] POST /identity/v3/projects => generated 262 bytes in 357 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:49.105123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:49.171885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a3024-e787-4988-8d17-f596ac890b01 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:49.239327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:49.241025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:49.241539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:49.242050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:49.243429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:49.245380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:49.257613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:49.258688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:47:49.259569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:49.268011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 356/733] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Oct 11 11:47:48 2022] GET /identity/v3/services/image => generated 86 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:49.269934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:49.288169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639215-a0e7-441a-855a-4f4bfaed5d8a None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:49.330718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:49.331405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:49.331675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:49.331936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:49.339927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:49.341591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:47:49.354257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:49.356031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:49.357899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 378/734] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:49.364741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:49.387668 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:49.440454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f36df3-62f2-4f41-a4f5-20f0172ef1e2 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:49.477016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:49.486890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:49.487677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:49.487959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:49.488221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:49.489108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] RBAC: Adding query filter params (name=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:49.489720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:49.491660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:49.497846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7ff61-1d78-4f42-9136-2c02ccda6898 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:49.504253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 357/735] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:49.506149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:49.569023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfb240-8ced-44e3-83e5-49251816c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:49.569686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfb240-8ced-44e3-83e5-49251816c6cc None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:49.570007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfb240-8ced-44e3-83e5-49251816c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:49.570276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfb240-8ced-44e3-83e5-49251816c6cc None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:49.571080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfb240-8ced-44e3-83e5-49251816c6cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:49.571316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfb240-8ced-44e3-83e5-49251816c6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:49.572890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfb240-8ced-44e3-83e5-49251816c6cc None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:49.608706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 379/736] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:49.700348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59a0f4-3832-41bb-ba0a-7ed84f3a9614 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:49.768379 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84120-c33a-4fe9-8fc4-678c9621f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:49.769700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84120-c33a-4fe9-8fc4-678c9621f2be None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:49.770318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84120-c33a-4fe9-8fc4-678c9621f2be None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:49.770967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84120-c33a-4fe9-8fc4-678c9621f2be None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:49.772280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84120-c33a-4fe9-8fc4-678c9621f2be None admin] RBAC: Adding query filter params (type=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:49.773110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84120-c33a-4fe9-8fc4-678c9621f2be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:49.775857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84120-c33a-4fe9-8fc4-678c9621f2be None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:49.785104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 358/737] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:50.807960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983251-5bfc-493a-8275-43a58c27e90d None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:50.808526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983251-5bfc-493a-8275-43a58c27e90d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:50.808927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983251-5bfc-493a-8275-43a58c27e90d None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:50.811832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 380/738] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:50.820794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8f663-8da6-4535-a7bd-6063943dcd21 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:50.821267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8f663-8da6-4535-a7bd-6063943dcd21 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:50.821828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8f663-8da6-4535-a7bd-6063943dcd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:50.853440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9ea8f663-8da6-4535-a7bd-6063943dcd21 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:50.855628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9ea8f663-8da6-4535-a7bd-6063943dcd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:50.966892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:50.993850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 359/739] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:51.503241 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1983251-5bfc-493a-8275-43a58c27e90d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:51.651503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:51.696249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1983251-5bfc-493a-8275-43a58c27e90d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:51.758621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:51.759662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:51.760125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:51.760631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:51.761706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:51.764235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:51.781498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:51.783890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:51.785946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 381/740] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:51.794795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8f663-8da6-4535-a7bd-6063943dcd21 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:51.946628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8f663-8da6-4535-a7bd-6063943dcd21 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:51.993614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:51.994235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:51.994509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:51.994816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:51.995461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:51.995756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:51.997140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:52.003017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 360/741] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:52.008550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:52.123401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91005b4-7d89-4085-ade1-14f98953c987 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:52.167921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d53ac-fb73-4abc-b42e-271bdbe762f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:52.168554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d53ac-fb73-4abc-b42e-271bdbe762f4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.168833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d53ac-fb73-4abc-b42e-271bdbe762f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.169091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d53ac-fb73-4abc-b42e-271bdbe762f4 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.169809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d53ac-fb73-4abc-b42e-271bdbe762f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:52.170119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d53ac-fb73-4abc-b42e-271bdbe762f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:52.171733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d53ac-fb73-4abc-b42e-271bdbe762f4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:52.178075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 382/742] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:52.187767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:52.251066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:52.308801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8daf-db52-47a6-8601-038d698576f6 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:52.316946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d8861-383b-4c4e-bd93-d6f5ed92f387 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.317899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d8861-383b-4c4e-bd93-d6f5ed92f387 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.318944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d8861-383b-4c4e-bd93-d6f5ed92f387 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.329089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 383/743] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:52.331918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc130a-8c6d-4064-9f90-62674ac3de1a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.332809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc130a-8c6d-4064-9f90-62674ac3de1a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.333582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc130a-8c6d-4064-9f90-62674ac3de1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.351076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:52.359329 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:52.359964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.360241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.360508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.361221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] RBAC: Adding query filter params (interface=public, service_id=3ff1815ea00d41288a5f220ed838d62f, region_id=RegionOne) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:52.361525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:52.363063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:52.371825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 361/744] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:47:52 2022] GET /identity/v3/endpoints?service_id=3ff1815ea00d41288a5f220ed838d62f&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:52.380155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:52.381313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-52cc130a-8c6d-4064-9f90-62674ac3de1a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:52.384663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-52cc130a-8c6d-4064-9f90-62674ac3de1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:52.513815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 384/745] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:52.520058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ac831-22cc-40fa-bc83-5358d1c35f54 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:52.551275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:52.566256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60581a-29d6-4ad5-b3d8-520c8915410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:52.566920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60581a-29d6-4ad5-b3d8-520c8915410f None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.567194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60581a-29d6-4ad5-b3d8-520c8915410f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.567465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60581a-29d6-4ad5-b3d8-520c8915410f None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.568068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60581a-29d6-4ad5-b3d8-520c8915410f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:52.569509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60581a-29d6-4ad5-b3d8-520c8915410f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:52.576681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 362/746] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:52 2022] GET /identity/v3/services => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 11:47:52.647262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901308be-4986-40c4-a66a-6a64ae3bb2d6 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.647505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901308be-4986-40c4-a66a-6a64ae3bb2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.647843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901308be-4986-40c4-a66a-6a64ae3bb2d6 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.649375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 385/747] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:52.655276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0503f-01e4-41da-bf0f-21a64d404440 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.655695 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0503f-01e4-41da-bf0f-21a64d404440 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.655837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0503f-01e4-41da-bf0f-21a64d404440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.662209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7396b-a917-4fbe-ae37-3ba23c3f366e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.662470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7396b-a917-4fbe-ae37-3ba23c3f366e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.662844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7396b-a917-4fbe-ae37-3ba23c3f366e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.664600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 386/748] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:52.676082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90cd67-6b74-45a9-8222-dcf69be65112 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:52.677006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90cd67-6b74-45a9-8222-dcf69be65112 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:52.677724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90cd67-6b74-45a9-8222-dcf69be65112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:52.682595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b0b0503f-01e4-41da-bf0f-21a64d404440 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:52.684051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b0b0503f-01e4-41da-bf0f-21a64d404440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:52.708090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8b90cd67-6b74-45a9-8222-dcf69be65112 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:52.710818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8b90cd67-6b74-45a9-8222-dcf69be65112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:52.818619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 387/749] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:52.830990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 363/750] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:53.054012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90cd67-6b74-45a9-8222-dcf69be65112 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:53.124006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0503f-01e4-41da-bf0f-21a64d404440 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:53.126273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:53.174543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90cd67-6b74-45a9-8222-dcf69be65112 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:53.219923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:53.220795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:53.221088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:53.221540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:53.222061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:53.223914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:53.237885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:53.238956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:53.239820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:53.241249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 388/751] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:53.242395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:53.285232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0503f-01e4-41da-bf0f-21a64d404440 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:53.300000 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:53.332091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:53.333171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:53.333747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:53.334222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:53.335300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:53.337260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:53.341068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING keystone.server.flask.common [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 11 11:47:53.357878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.sql.core [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 11:47:53.357878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 11 11:47:53.357878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [parameters: {'user_id': '1a64c80d42f1430e8b61d7ead3cad9b4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 11 11:47:53.357878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81391) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 11:47:53.375489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126180-f1fb-4d87-933f-95f71fd4a392 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result.read() Oct 11 11:47:53.385924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:47:53.387960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application yield resource Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise self.value Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application session.commit() Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 11:47:53.389959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.session.flush() Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application compat.raise_( Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 11:47:53.391940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:47:53.393893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result.read() Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:47:53.395873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [parameters: {'user_id': '1a64c80d42f1430e8b61d7ead3cad9b4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:53.400017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 11 11:47:53.401874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 11 11:47:53.403891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 11 11:47:53.403891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 11 11:47:53.403891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 11:47:53.403891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 11:47:53.403891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 11 11:47:53.403891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:53.406619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 364/752] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Oct 11 11:47:53 2022] POST /identity/v3/users => generated 160 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:53.407666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:53.426102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:53.463799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:53.464829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:53.465295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:53.465735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:53.466743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:53.469361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:53.495642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 389/753] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:47:53 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:53.496800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:53.618638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac46eaa-591f-4505-8099-e6fd53e55f54 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:53.753871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44d349-4c0c-4d57-bd1f-8ee2a1290911 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:53.777125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:53.778748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:53.779641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:53.780625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:53.782238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:53.783219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:53.787164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:53.810509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 365/754] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:53.823694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:53.855250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:53.855972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:53.856259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:53.856574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:53.875790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:53.877085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:53.893509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:53.895416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:53.897362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 390/755] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:47:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:53.901337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:53.910106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:53.962114 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:54.033500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0747ac-1ca7-4483-9fef-b494d9a6180c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:54.046665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfff60-1d9c-4f2a-ac08-46fa28556309 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:54.073888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:54.074528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:54.074899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:54.075174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:54.075998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:54.076357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:54.078063 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:54.116794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:54.117951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:54.118526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:54.119105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:54.120392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:54.121020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:54.123735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:54.126277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 391/756] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Oct 11 11:47:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:54.139073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 366/757] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:54.144368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:54.338773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0691c9-ba22-4051-9aad-80c4e6c1b2a8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:54.341060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:54.381311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab5ce5-54e1-4bf0-b0f4-5ca66bcd16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:54.381927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5ce5-54e1-4bf0-b0f4-5ca66bcd16db None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:54.382211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5ce5-54e1-4bf0-b0f4-5ca66bcd16db None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:54.382472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5ce5-54e1-4bf0-b0f4-5ca66bcd16db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:54.383238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab5ce5-54e1-4bf0-b0f4-5ca66bcd16db None admin] RBAC: Adding query filter params (interface=admin, service_id=bf57ef6cc5df45289e5b747ac7206497, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:54.383553 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab5ce5-54e1-4bf0-b0f4-5ca66bcd16db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:54.385076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab5ce5-54e1-4bf0-b0f4-5ca66bcd16db None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:54.391970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 392/758] 10.222.0.48 () {56 vars in 1249 bytes} [Tue Oct 11 11:47:54 2022] GET /identity/v3/endpoints?service_id=bf57ef6cc5df45289e5b747ac7206497&interface=admin®ion_id=RegionOne => generated 193 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:54.397850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:54.528368 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:54.532399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e411da-da1b-4557-9b93-35c60dc3e85c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:54.573016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0700d8-9b97-41b1-88b7-0c099e705e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:54.573631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0700d8-9b97-41b1-88b7-0c099e705e84 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:54.573900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0700d8-9b97-41b1-88b7-0c099e705e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:54.574162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0700d8-9b97-41b1-88b7-0c099e705e84 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:54.574794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0700d8-9b97-41b1-88b7-0c099e705e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:54.576178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0700d8-9b97-41b1-88b7-0c099e705e84 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:54.584174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 367/759] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:54 2022] GET /identity/v3/services => generated 1957 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:47:55.128146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b721c1-defe-4a4b-8715-af28e7ecd65a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:55.128759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b721c1-defe-4a4b-8715-af28e7ecd65a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:55.128759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b721c1-defe-4a4b-8715-af28e7ecd65a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:55.130041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 393/760] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:55.138626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41678-a322-4c49-b8ef-c5dc969d4ce6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:55.138910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41678-a322-4c49-b8ef-c5dc969d4ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:55.139319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41678-a322-4c49-b8ef-c5dc969d4ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:55.159390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-efa41678-a322-4c49-b8ef-c5dc969d4ce6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:55.160922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-efa41678-a322-4c49-b8ef-c5dc969d4ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:55.233978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 368/761] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:55 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:55.496281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b721c1-defe-4a4b-8715-af28e7ecd65a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:55.606348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b721c1-defe-4a4b-8715-af28e7ecd65a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:55.644116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:55.644762 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:55.645036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:55.645301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:55.645890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:55.647295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:55.656659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:55.657731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:47:55.658597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 394/762] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:47:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:55.664178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41678-a322-4c49-b8ef-c5dc969d4ce6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:55.765030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:55.773676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41678-a322-4c49-b8ef-c5dc969d4ce6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:55.809865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3b5c4-61a4-4b75-9337-b9044b1faf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:55.810618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b5c4-61a4-4b75-9337-b9044b1faf3c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:55.810963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b5c4-61a4-4b75-9337-b9044b1faf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:55.811295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3b5c4-61a4-4b75-9337-b9044b1faf3c None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:55.812042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b5c4-61a4-4b75-9337-b9044b1faf3c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:55.812416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b5c4-61a4-4b75-9337-b9044b1faf3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:55.813976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3b5c4-61a4-4b75-9337-b9044b1faf3c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:55.825049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 369/763] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:55.827161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:55.881411 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:55.939434 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c59b5a-8341-4de2-ab26-91937a39de9c None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:55.939764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c59b5a-8341-4de2-ab26-91937a39de9c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:55.939975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c59b5a-8341-4de2-ab26-91937a39de9c None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:55.941483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 370/764] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:47:55.947346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684b4b-c80b-4cb5-bf79-555d1c72d736 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:55.947626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684b4b-c80b-4cb5-bf79-555d1c72d736 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:55.947896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684b4b-c80b-4cb5-bf79-555d1c72d736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:55.966833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f3684b4b-c80b-4cb5-bf79-555d1c72d736 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:55.968017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f3684b4b-c80b-4cb5-bf79-555d1c72d736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:56.005138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ba86-91cb-4475-926e-2da1f5aee4fb None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:56.044603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:56.045119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:56.045389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:56.045650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:56.046284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:56.046537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:56.047934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:56.058312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 395/765] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Oct 11 11:47:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:56.060223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:56.080116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 371/766] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:55 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:56.176717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:56.184687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963af4-95bb-4d93-a914-65c8f2e42368 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:56.220505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:56.221129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:56.221407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:56.221677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:56.222344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:56.223806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:56.250946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 396/767] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:47:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:56.344077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3684b4b-c80b-4cb5-bf79-555d1c72d736 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:56.455039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:56.469477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3684b4b-c80b-4cb5-bf79-555d1c72d736 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:56.516231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:56.516879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:56.517154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:56.517422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:56.518042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:56.519466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:56.529642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:56.530761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:56.531990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 372/768] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Oct 11 11:47:56 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:56.542389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:56.692923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2e0a5-6509-4c0e-a463-5595298abbea None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:56.750742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:56.751780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:56.752247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:56.752701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:56.753838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] RBAC: Adding query filter params (name=image) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:56.754362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:56.756907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:56.771041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 397/769] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:56.773505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:56.938090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c91dce-5d29-48a1-8136-e21c593dd4d7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:56.983168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25b5b-5abb-4999-bb4a-6569ba26f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:56.983807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25b5b-5abb-4999-bb4a-6569ba26f25b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:56.984083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25b5b-5abb-4999-bb4a-6569ba26f25b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:56.984353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25b5b-5abb-4999-bb4a-6569ba26f25b None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:56.984981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25b5b-5abb-4999-bb4a-6569ba26f25b None admin] RBAC: Adding query filter params (type=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:56.985272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25b5b-5abb-4999-bb4a-6569ba26f25b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:56.986697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25b5b-5abb-4999-bb4a-6569ba26f25b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:56.992943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 373/770] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:56.999613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:57.027042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:57.150304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12718d-93f2-4bc9-9f3b-b5bc8d5a3439 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:57.151086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12718d-93f2-4bc9-9f3b-b5bc8d5a3439 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:57.151591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12718d-93f2-4bc9-9f3b-b5bc8d5a3439 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:57.154036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 374/771] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:47:57.160706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4aac9-c8a2-4597-9ed2-bb2d0027f6b9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:57.161102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4aac9-c8a2-4597-9ed2-bb2d0027f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:57.161277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4aac9-c8a2-4597-9ed2-bb2d0027f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:57.182816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff43a79-038b-49c4-9109-94b4626ce937 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:57.187506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fcd4aac9-c8a2-4597-9ed2-bb2d0027f6b9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:57.188949 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fcd4aac9-c8a2-4597-9ed2-bb2d0027f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:57.197747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:57.238711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:57.239259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:57.239556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:57.239975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:57.240756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] RBAC: Adding query filter params (interface=public, service_id=887e14fb8c0d4bb18456e960071bd17e, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:57.241018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:57.242737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:57.250180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 398/772] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:47:56 2022] GET /identity/v3/endpoints?service_id=887e14fb8c0d4bb18456e960071bd17e&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:47:57.255842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:57.274106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 375/773] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:57 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:57.384807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:57.411990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3be88-78a9-4ac7-88dd-4dcd1ac836aa None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:57.451352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:57.452261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:57.452687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:57.453089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:57.453841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:57.455381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:57.463282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 399/774] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:47:57 2022] GET /identity/v3/services => generated 1957 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 11:47:57.540906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4aac9-c8a2-4597-9ed2-bb2d0027f6b9 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:57.687689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd4aac9-c8a2-4597-9ed2-bb2d0027f6b9 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:57.756180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:57.757187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:57.757452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:57.757718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:57.758313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:57.760309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:57.777452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:57.778842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:57.779946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 376/775] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 11 11:47:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:57.789547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:57.913903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f5e79-0fd9-4aae-95d1-6db3f2ef1107 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:57.964096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:57.965074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:57.965534 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:57.965975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:57.967135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:57.967623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:57.969758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:57.980274 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 400/776] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:57.986890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:57.997666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:58.114526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d916339-ff4e-423f-8163-76e6e7cbe020 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:58.157733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda5af8-95a2-4bdd-822b-9fbbcab1170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:58.158364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda5af8-95a2-4bdd-822b-9fbbcab1170c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:58.158666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda5af8-95a2-4bdd-822b-9fbbcab1170c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:58.158929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda5af8-95a2-4bdd-822b-9fbbcab1170c None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:58.159573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda5af8-95a2-4bdd-822b-9fbbcab1170c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:58.159864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda5af8-95a2-4bdd-822b-9fbbcab1170c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:58.161287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda5af8-95a2-4bdd-822b-9fbbcab1170c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:58.167447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 377/777] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 11 11:47:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:58.173699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:58.184132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:58.299942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31730-8b98-4c1a-b05d-88f4e2fc3d3f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:58.343515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd9501-111c-4b57-997c-00ac559d3783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:58.344157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd9501-111c-4b57-997c-00ac559d3783 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:58.344504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd9501-111c-4b57-997c-00ac559d3783 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:58.344780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd9501-111c-4b57-997c-00ac559d3783 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:58.345489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd9501-111c-4b57-997c-00ac559d3783 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:58.346979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd9501-111c-4b57-997c-00ac559d3783 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:58.366537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 401/778] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:47:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:47:58.711649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117dfa-090d-4523-b596-8f4a6edb3255 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:58.712381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117dfa-090d-4523-b596-8f4a6edb3255 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:58.712381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1117dfa-090d-4523-b596-8f4a6edb3255 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:58.713787 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 378/779] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:58.719110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f56c-8a51-4207-9d5a-9dd7e3adad41 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:58.719409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f56c-8a51-4207-9d5a-9dd7e3adad41 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:58.719677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f56c-8a51-4207-9d5a-9dd7e3adad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:58.738726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5ba1f56c-8a51-4207-9d5a-9dd7e3adad41 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:58.739924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5ba1f56c-8a51-4207-9d5a-9dd7e3adad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:58.807630 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:58.826663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 402/780] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:47:59.094705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117dfa-090d-4523-b596-8f4a6edb3255 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:59.174605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:59.209432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1117dfa-090d-4523-b596-8f4a6edb3255 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:59.247123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:59.247674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:59.247951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:59.248219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:59.259538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:47:59.264472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:59.265431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:59.271106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 379/781] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 11 11:47:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:47:59.272596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f56c-8a51-4207-9d5a-9dd7e3adad41 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:59.384279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f56c-8a51-4207-9d5a-9dd7e3adad41 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:59.420275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:59.420928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:59.421195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:59.421461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:59.422149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:59.422441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:59.423885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:59.437031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 403/782] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Oct 11 11:47:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:59.438531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:59.550301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216331-26e6-47f4-8fa1-6a54b17f8430 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:59.581516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:59.588996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:59.589631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:59.589904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:59.590165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:59.601342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:59.602862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:47:59.617398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:59.622857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:47:59.624059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:47:59.624059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:47:59.624059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:59.624059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 380/783] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:47:59.626283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:59.688594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:47:59.739703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360588f-cf68-4039-b0c9-762d50116d7e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:59.777460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55900b88-85de-48a4-a572-e2a5a95e8170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:59.778089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900b88-85de-48a4-a572-e2a5a95e8170 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:59.778473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900b88-85de-48a4-a572-e2a5a95e8170 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:59.778771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55900b88-85de-48a4-a572-e2a5a95e8170 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:59.779457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55900b88-85de-48a4-a572-e2a5a95e8170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:47:59.779761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55900b88-85de-48a4-a572-e2a5a95e8170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:59.781110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55900b88-85de-48a4-a572-e2a5a95e8170 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:59.794322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 404/784] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:47:59.799924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:47:59.848606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bde74-47ae-4a28-8974-7385d9d760cf None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:59.848810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bde74-47ae-4a28-8974-7385d9d760cf None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:59.849055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bde74-47ae-4a28-8974-7385d9d760cf None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:59.850432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 405/785] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:47:59.856161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b2af-264e-47c3-acf9-e34c2cbb18ce None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:59.856428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b2af-264e-47c3-acf9-e34c2cbb18ce None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:59.856704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b2af-264e-47c3-acf9-e34c2cbb18ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:59.875682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2b93b2af-264e-47c3-acf9-e34c2cbb18ce None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:47:59.877391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2b93b2af-264e-47c3-acf9-e34c2cbb18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:47:59.910929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862f116-7e76-4b7b-9f82-fec4b82130cd None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:47:59.951384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 406/786] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:47:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:47:59.957839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:47:59.958982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:47:59.959297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:47:59.959605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:47:59.974037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:47:59.978699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:47:59.991291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:47:59.992376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:47:59.993370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 381/787] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Oct 11 11:47:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:00.003615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93b2af-264e-47c3-acf9-e34c2cbb18ce None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.057019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:00.150923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93b2af-264e-47c3-acf9-e34c2cbb18ce None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.209548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:00.210587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.211073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.211535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.212858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:00.213390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:00.216034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:00.223232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.242457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 407/788] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 11 11:47:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:00.250921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.287481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:00.346947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606589b-8f22-4831-8334-41e0d376b2e1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.358728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbdb57-02c0-4d22-8775-c4fc197955b1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.360350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:00.382820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:00.383510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.383832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.384270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] PATH_INFO: `/v3/services/image` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.384903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:00.386281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:00.396880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:00.397959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:00.398819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 382/789] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Oct 11 11:48:00 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:00.401035 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:00.401630 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.401903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.402166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.404140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.419932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:00.421898 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:48:00.439085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:00.440376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:48:00.441620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:48:00.441620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:00.441620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:00.441620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 408/790] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:00.446406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.535719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a0fc-e35f-4a21-ac84-93c745a2f750 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.545005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:00.585610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d820f2-3894-494f-a7d5-fc7353d23360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:00.586239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d820f2-3894-494f-a7d5-fc7353d23360 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.586515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d820f2-3894-494f-a7d5-fc7353d23360 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.586856 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d820f2-3894-494f-a7d5-fc7353d23360 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.587517 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d820f2-3894-494f-a7d5-fc7353d23360 None admin] RBAC: Adding query filter params (name=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:00.587807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d820f2-3894-494f-a7d5-fc7353d23360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:00.589228 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d820f2-3894-494f-a7d5-fc7353d23360 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:00.595055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 383/791] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:00.596444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d07e6b-c89f-4797-af24-3729d0921fa0 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.596732 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d07e6b-c89f-4797-af24-3729d0921fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.596995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d07e6b-c89f-4797-af24-3729d0921fa0 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.598690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 384/792] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:00.601896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d07e6b-c89f-4797-af24-3729d0921fa0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.696826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3a8ae-cda7-4242-bef9-cbe82232c2a8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.719593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d07e6b-c89f-4797-af24-3729d0921fa0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.735360 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77568e16-a2e0-4184-b1db-b4cb2628f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:00.736302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77568e16-a2e0-4184-b1db-b4cb2628f02d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.736746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77568e16-a2e0-4184-b1db-b4cb2628f02d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.737070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77568e16-a2e0-4184-b1db-b4cb2628f02d None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.738126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77568e16-a2e0-4184-b1db-b4cb2628f02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:00.738616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77568e16-a2e0-4184-b1db-b4cb2628f02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:00.740908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77568e16-a2e0-4184-b1db-b4cb2628f02d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:00.755551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 409/793] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:00.756945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755a780-c056-4810-92ed-6c8062dc03c0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.757203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755a780-c056-4810-92ed-6c8062dc03c0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.757476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755a780-c056-4810-92ed-6c8062dc03c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.767288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:00.767908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.768177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.768438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.769068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] RBAC: Adding query filter params (type=image) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:00.769349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:00.770760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:00.776240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 385/794] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:00.777073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.778001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6755a780-c056-4810-92ed-6c8062dc03c0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:00.779261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6755a780-c056-4810-92ed-6c8062dc03c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:00.790950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:00.816480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:00.851887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 410/795] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:00.852748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755a780-c056-4810-92ed-6c8062dc03c0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:00.899111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18ff7e-a7bf-4284-ae57-315d372f3582 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.943527 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:00.944509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:00.945309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:00.945730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:00.958627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:00.960806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:48:00.979978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:00.981195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:00.983072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 386/796] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:00.987751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755a780-c056-4810-92ed-6c8062dc03c0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:00.989955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:01.045678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:01.046140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:01.046232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:01.046497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:01.047636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:01.048644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:01.067801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:01.075690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 411/797] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:48:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:01.121961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:01.125140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:01.137019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138cc67-ddbd-47c1-a940-701859ffe162 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:01.187405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:01.188217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:01.188414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:01.188692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:01.189254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:01.189548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:01.191519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:01.206516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 387/798] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:01.223857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:01.277647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddfa10-2a0c-4043-9313-02ba4245a077 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:01.331579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:01.332286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:01.332699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:01.333029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:01.334326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:01.335799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:01.342588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 412/799] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:01.345766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:01.349988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c9911-b1c9-4bcc-bc35-f371ac059dc7 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:01.399464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad918ab8-e644-4d78-bf2b-e2c5ad5c2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:01.400138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad918ab8-e644-4d78-bf2b-e2c5ad5c2ddd None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:01.400415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad918ab8-e644-4d78-bf2b-e2c5ad5c2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:01.400676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad918ab8-e644-4d78-bf2b-e2c5ad5c2ddd None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/c3fb3dc7226c48f1a33c6e73d3ff32a6/roles/32716052f3054ba4b5d57af19c157f1a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:01.403140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad918ab8-e644-4d78-bf2b-e2c5ad5c2ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=c3fb3dc7226c48f1a33c6e73d3ff32a6, role_id=32716052f3054ba4b5d57af19c157f1a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:01.404522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad918ab8-e644-4d78-bf2b-e2c5ad5c2ddd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:01.425372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 388/800] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:48:01 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/c3fb3dc7226c48f1a33c6e73d3ff32a6/roles/32716052f3054ba4b5d57af19c157f1a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:48:01.456139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:01.505222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cfbb6-d82c-4c98-854b-00f00151a4d5 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:01.560643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f67a0-76df-4286-bddf-d6bbd16c5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:01.561281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f67a0-76df-4286-bddf-d6bbd16c5d89 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:01.561554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f67a0-76df-4286-bddf-d6bbd16c5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:01.561819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f67a0-76df-4286-bddf-d6bbd16c5d89 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:01.562531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f67a0-76df-4286-bddf-d6bbd16c5d89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:01.564078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f67a0-76df-4286-bddf-d6bbd16c5d89 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:01.608384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 413/801] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:48:01 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:03.264250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e453f-bddb-4cfe-a947-b5dabe0b345b None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:03.264755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e453f-bddb-4cfe-a947-b5dabe0b345b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:03.264755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e453f-bddb-4cfe-a947-b5dabe0b345b None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:03.265998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 389/802] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:03.271654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257ae3-0f35-4bcd-aa36-e6c191b4d759 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:03.272078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257ae3-0f35-4bcd-aa36-e6c191b4d759 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:03.272172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257ae3-0f35-4bcd-aa36-e6c191b4d759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:03.290598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4b257ae3-0f35-4bcd-aa36-e6c191b4d759 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:03.291756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4b257ae3-0f35-4bcd-aa36-e6c191b4d759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:03.364439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 414/803] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:03.626538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e453f-bddb-4cfe-a947-b5dabe0b345b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:03.640689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:03.743824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e453f-bddb-4cfe-a947-b5dabe0b345b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:03.778603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:03.779234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:03.779502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:03.779762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:03.780443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:03.782066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:03.790803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.sql.core [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 11:48:03.790803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 11:48:03.790803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [parameters: {'id': '66f282b2c33341bd8bb5dd3b9b17444f', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 11:48:03.790803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81391) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-ae5b2e01-0988-47e7-b0d0-029405df980a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:48:03.798648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result.read() Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 11 11:48:03.799459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application yield resource Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application next(self.gen) Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.session.rollback() Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.force_reraise() Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise self.value Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application session.commit() Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 11 11:48:03.803524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._prepare_impl() Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.session.flush() Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._flush(objects) Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application compat.raise_( Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application flush_context.execute() Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rec.execute(self) Oct 11 11:48:03.804788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 11:48:03.805754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result = self._query(query) Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application conn.query(q) Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application result.read() Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 11 11:48:03.806724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [parameters: {'id': '66f282b2c33341bd8bb5dd3b9b17444f', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 11 11:48:03.807816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:03.808854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:03.809972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 390/804] 10.222.0.48 () {60 vars in 1137 bytes} [Tue Oct 11 11:48:03 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:03.810927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257ae3-0f35-4bcd-aa36-e6c191b4d759 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:03.817218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e608df-1fab-4d8d-b35c-df135e65e8c3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:03.817498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e608df-1fab-4d8d-b35c-df135e65e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:03.817767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e608df-1fab-4d8d-b35c-df135e65e8c3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:03.819958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 391/805] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:48:03.825047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b411-1016-4900-927f-ebf11d259105 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:03.825301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b411-1016-4900-927f-ebf11d259105 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:03.825559 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687b411-1016-4900-927f-ebf11d259105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:03.843316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4687b411-1016-4900-927f-ebf11d259105 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:03.844490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4687b411-1016-4900-927f-ebf11d259105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:03.866152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:03.912715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 392/806] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:48:03.925738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257ae3-0f35-4bcd-aa36-e6c191b4d759 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:03.960272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:03.960895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:03.961166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:03.961426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:03.978284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:03.979831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:48:03.995564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:03.996545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:48:04.000927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:48:04.000927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:04.000927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:04.000927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 415/807] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:04.003721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b411-1016-4900-927f-ebf11d259105 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:04.007404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:04.107111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687b411-1016-4900-927f-ebf11d259105 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:04.142644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:04.143248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:04.143529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:04.143774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:04.144427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:04.144714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:04.146071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:04.158383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 393/808] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:04.174845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:04.288857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f71c01-8470-4b2d-8a0e-1d4385958588 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:04.290985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:04.330429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0499-ac7c-481b-826c-740ccfb896a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:04.331189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0499-ac7c-481b-826c-740ccfb896a4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:04.331520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0499-ac7c-481b-826c-740ccfb896a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:04.331846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0499-ac7c-481b-826c-740ccfb896a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:04.333042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc0499-ac7c-481b-826c-740ccfb896a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:04.334530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc0499-ac7c-481b-826c-740ccfb896a4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:04.336480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 416/809] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:04.342439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:04.408238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:04.452945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8ea3-19d6-4c9c-9c3e-4b68aafdf56c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:04.489328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530dc95-37e5-48c7-a270-5aa778763b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:04.489946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530dc95-37e5-48c7-a270-5aa778763b53 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:04.490216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530dc95-37e5-48c7-a270-5aa778763b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:04.490474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530dc95-37e5-48c7-a270-5aa778763b53 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:04.491191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530dc95-37e5-48c7-a270-5aa778763b53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:04.492604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530dc95-37e5-48c7-a270-5aa778763b53 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:04.515158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 394/810] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:48:04 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:05.126853 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a676-073e-4b52-8f84-3cd8520c80c1 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:05.127157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a676-073e-4b52-8f84-3cd8520c80c1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:05.127423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a676-073e-4b52-8f84-3cd8520c80c1 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:05.128967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 417/811] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:05.135452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f409-fdec-4a81-9a29-4915218f5cc7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:05.136074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f409-fdec-4a81-9a29-4915218f5cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:05.136074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58f409-fdec-4a81-9a29-4915218f5cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:05.159149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1d58f409-fdec-4a81-9a29-4915218f5cc7 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:05.160351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1d58f409-fdec-4a81-9a29-4915218f5cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:05.234205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 395/812] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:05.497441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a676-073e-4b52-8f84-3cd8520c80c1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:05.605083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a676-073e-4b52-8f84-3cd8520c80c1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:05.640101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:05.640745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:05.641019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:05.641279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:05.652902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:48:05.657681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:05.663058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:05.664056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 418/813] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 11 11:48:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:05.666723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58f409-fdec-4a81-9a29-4915218f5cc7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:05.737304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:05.790698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58f409-fdec-4a81-9a29-4915218f5cc7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:05.827035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:05.827644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:05.827916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:05.828177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:05.828849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:05.829143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:05.830522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:05.839578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 396/814] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Oct 11 11:48:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:05.845447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:05.879377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:05.961233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637edd6-f152-4cdc-ae6c-79594e95a762 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:06.000533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:06.001192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:06.001470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:06.001729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:06.015200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:06.017629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:48:06.033395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:06.034695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:48:06.035607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:48:06.035607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:06.035607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:06.035607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 419/815] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:06.040559 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:06.153735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc33316-b50f-4697-931b-8f3843b85574 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:06.167725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:06.190479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:06.191185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:06.191466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:06.191729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:06.192437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:06.192741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:06.194216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:06.208300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 397/816] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:06.214600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:06.308896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:06.328751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0d90-7d86-47ac-84d7-9a8f097be728 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:06.363686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:06.364339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:06.364603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:06.364849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:06.373156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:06.374605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:48:06.386614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:06.387739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 11 11:48:06.388682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:06.390743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 420/817] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Oct 11 11:48:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:06.394177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:06.509407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97783c5-378f-46ca-afcc-99d936b957ee None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:06.549969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841beabd-f72f-4735-8508-b6046b299d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:06.550585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841beabd-f72f-4735-8508-b6046b299d8c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:06.550878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841beabd-f72f-4735-8508-b6046b299d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:06.551121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841beabd-f72f-4735-8508-b6046b299d8c None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:06.551877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841beabd-f72f-4735-8508-b6046b299d8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:06.552162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841beabd-f72f-4735-8508-b6046b299d8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:06.553632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841beabd-f72f-4735-8508-b6046b299d8c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:06.574082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 398/818] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 11 11:48:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:06.580196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:06.705594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905ec8f-88d0-49e5-8d45-ec2dad718668 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:06.740108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83098d08-e120-4ca4-9198-a5d986b8f3b4 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:06.740741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83098d08-e120-4ca4-9198-a5d986b8f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:06.740741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83098d08-e120-4ca4-9198-a5d986b8f3b4 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:06.740899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:06.741415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:06.741699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:06.741961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:06.742057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 399/819] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:48:06.747470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10dd1-8b8f-454f-b58a-282ac370783b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:06.747712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10dd1-8b8f-454f-b58a-282ac370783b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:06.748002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e10dd1-8b8f-454f-b58a-282ac370783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:06.755467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:06.767627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b5e10dd1-8b8f-454f-b58a-282ac370783b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:06.768757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b5e10dd1-8b8f-454f-b58a-282ac370783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:06.795535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:06.816758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:06.818202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:06.842887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 400/820] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:48:06.928200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 421/821] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:48:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:48:06.935968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10dd1-8b8f-454f-b58a-282ac370783b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.068323 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e10dd1-8b8f-454f-b58a-282ac370783b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.104558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.105202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.105476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.105735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.111729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.118175 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.119681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:48:07.136723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:07.138020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:48:07.139113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:48:07.139113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:48:07.139113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:07.139113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 401/822] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:07.143742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.159742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:07.160467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:07.224317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a8ebe-c237-4c99-b4fa-cadc561a0673 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.252136 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce34e6-89d5-4957-a578-dc2169fbe9c8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.260382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.261017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.261299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.261562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.272108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:48:07.276990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:07.278130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:07.278977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 422/823] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:48:07.284393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.288931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.289551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.289941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.290207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.290895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:07.291185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.292910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.305910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 402/824] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:07.312435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.393710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:07.394121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11948a0b-308c-42c1-abd3-028d0068b19f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.396058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:07.428407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62c6d2-164d-4c53-a391-5f137912eb46 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.434178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.434862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.435135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.435381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.436099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:07.436421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.437808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.452078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 423/825] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:07.453528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.467788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.468435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.468712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.468976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.476376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.477936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:48:07.490836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:07.491990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:07.493364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 403/826] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:07.498204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.568104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf727b9-f22b-488f-9c05-ab81ce89e618 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.604591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.605252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.605480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.605734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] PATH_INFO: `/v3/users/661eae70c41c414cb984e5ae6bc817e2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.609032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534a7c-5fd4-48e2-a494-0b382062fd2e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.620442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] RBAC: Authorizing `identity:get_user(user_id=661eae70c41c414cb984e5ae6bc817e2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.621881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.623619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 424/827] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/users/661eae70c41c414cb984e5ae6bc817e2 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:07.629611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.640865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:07.647858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.648516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.648785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.649066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.649879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:07.650357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.652875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.654885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:07.667292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 404/828] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:07.674193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.751150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f05644-dc2f-43ee-9282-871236a6f227 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.789019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43bc93-8892-4f4e-b5a8-50df30b3cb00 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.789628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.790263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.790532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.790950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] PATH_INFO: `/v3/projects/f3e22ed84d844264ae104ec32daf49a1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.792079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] RBAC: Authorizing `identity:get_project(project_id=f3e22ed84d844264ae104ec32daf49a1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.793854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.797044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 425/829] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/projects/f3e22ed84d844264ae104ec32daf49a1 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:07.801691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:07.828453 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885da8d-f995-4207-a376-2dda20849d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.829154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885da8d-f995-4207-a376-2dda20849d1c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.829542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885da8d-f995-4207-a376-2dda20849d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.829942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885da8d-f995-4207-a376-2dda20849d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.830845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885da8d-f995-4207-a376-2dda20849d1c None admin] RBAC: Adding query filter params (role.id=32716052f3054ba4b5d57af19c157f1a, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=c3fb3dc7226c48f1a33c6e73d3ff32a6) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:07.831281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885da8d-f995-4207-a376-2dda20849d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.832946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885da8d-f995-4207-a376-2dda20849d1c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.839094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 405/830] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:48:07 2022] GET /identity/v3/role_assignments?user.id=c3fb3dc7226c48f1a33c6e73d3ff32a6&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=32716052f3054ba4b5d57af19c157f1a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:48:07.912125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:07.924260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8e54-eaef-403f-981f-1d7ee2a4d58e None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:07.963269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103b660-4b8e-4dc9-acc7-47e39deb2e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:07.963949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103b660-4b8e-4dc9-acc7-47e39deb2e8f None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:07.964221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103b660-4b8e-4dc9-acc7-47e39deb2e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:07.964468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103b660-4b8e-4dc9-acc7-47e39deb2e8f None admin] PATH_INFO: `/v3/projects/f3e22ed84d844264ae104ec32daf49a1/users/661eae70c41c414cb984e5ae6bc817e2/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:07.966493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103b660-4b8e-4dc9-acc7-47e39deb2e8f None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e22ed84d844264ae104ec32daf49a1, user_id=661eae70c41c414cb984e5ae6bc817e2, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:07.967980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103b660-4b8e-4dc9-acc7-47e39deb2e8f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:07.984107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 426/831] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:48:07 2022] PUT /identity/v3/projects/f3e22ed84d844264ae104ec32daf49a1/users/661eae70c41c414cb984e5ae6bc817e2/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:48:10.157132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994de18-722a-4068-b3c7-209258f4e1ef None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:10.157684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994de18-722a-4068-b3c7-209258f4e1ef None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:10.157684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994de18-722a-4068-b3c7-209258f4e1ef None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:10.159068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 406/832] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:10.165357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70130-d633-4d1a-ad01-bfd36d492e81 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:10.165904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70130-d633-4d1a-ad01-bfd36d492e81 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:10.165904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70130-d633-4d1a-ad01-bfd36d492e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:10.186421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7ad70130-d633-4d1a-ad01-bfd36d492e81 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:10.187676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7ad70130-d633-4d1a-ad01-bfd36d492e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:10.262807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 427/833] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:10.524609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994de18-722a-4068-b3c7-209258f4e1ef None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:10.585101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:10.633309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994de18-722a-4068-b3c7-209258f4e1ef None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:10.669546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:10.670200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:10.670463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:10.670754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:10.681347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:48:10.686129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:10.687233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:10.688185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 407/834] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:10.693599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70130-d633-4d1a-ad01-bfd36d492e81 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:10.777036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:10.799027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70130-d633-4d1a-ad01-bfd36d492e81 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:10.836371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:10.837027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:10.837302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:10.837571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:10.838237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:10.838545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:10.839959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:10.848260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 428/835] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:10.854766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:10.962471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663441c-3335-4353-9ebe-e8ca2b0f051a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:10.988572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:11.008151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:11.008843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:11.009115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:11.009378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] PATH_INFO: `/v3/users/661eae70c41c414cb984e5ae6bc817e2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:11.010515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] RBAC: Authorizing `identity:get_user(user_id=661eae70c41c414cb984e5ae6bc817e2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:11.012024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:11.013643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 408/836] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:10 2022] GET /identity/v3/users/661eae70c41c414cb984e5ae6bc817e2 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:11.019693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:11.127349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e42594-0f94-4a29-8295-806d4631ff87 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:11.161393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:11.162009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:11.162273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:11.162534 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:11.174870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:11.232081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:11.233528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:11.333571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 429/837] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:48:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:48:11.339894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:11.446353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545162b2-7091-43a2-b5af-8b62e16520f5 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:11.480689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27341eb-bad5-4b86-96b3-cf83b56423c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:11.481309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27341eb-bad5-4b86-96b3-cf83b56423c2 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:11.481581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27341eb-bad5-4b86-96b3-cf83b56423c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:11.481864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27341eb-bad5-4b86-96b3-cf83b56423c2 None admin] PATH_INFO: `/v3/projects/f3e22ed84d844264ae104ec32daf49a1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:11.483030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27341eb-bad5-4b86-96b3-cf83b56423c2 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e22ed84d844264ae104ec32daf49a1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:11.484469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27341eb-bad5-4b86-96b3-cf83b56423c2 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:11.486238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 409/838] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:11 2022] GET /identity/v3/projects/f3e22ed84d844264ae104ec32daf49a1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:11.492722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:11.537473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:11.595249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26faf925-b587-4d66-ba95-906cd77e384d None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:11.630838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fa015-08f7-4457-897b-6fa24151b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:11.631417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fa015-08f7-4457-897b-6fa24151b0cf None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:11.631717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fa015-08f7-4457-897b-6fa24151b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:11.631979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fa015-08f7-4457-897b-6fa24151b0cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:11.632697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fa015-08f7-4457-897b-6fa24151b0cf None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=f3e22ed84d844264ae104ec32daf49a1, user.id=661eae70c41c414cb984e5ae6bc817e2) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:11.633002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fa015-08f7-4457-897b-6fa24151b0cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:11.634440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fa015-08f7-4457-897b-6fa24151b0cf None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:11.640432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 430/839] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:48:11 2022] GET /identity/v3/role_assignments?user.id=661eae70c41c414cb984e5ae6bc817e2&scope.project.id=f3e22ed84d844264ae104ec32daf49a1&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:13.755322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91576b7-9b2c-4866-98fd-dddd0d24a4c0 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:13.755868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91576b7-9b2c-4866-98fd-dddd0d24a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:13.755868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91576b7-9b2c-4866-98fd-dddd0d24a4c0 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:13.757172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 410/840] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:13.762721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d264a86-83ae-44a6-837d-11f1d940b348 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:13.763162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d264a86-83ae-44a6-837d-11f1d940b348 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:13.763249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d264a86-83ae-44a6-837d-11f1d940b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:13.782452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2d264a86-83ae-44a6-837d-11f1d940b348 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:13.783681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2d264a86-83ae-44a6-837d-11f1d940b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:13.857559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 431/841] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:14.120511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91576b7-9b2c-4866-98fd-dddd0d24a4c0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:14.177286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:14.227649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91576b7-9b2c-4866-98fd-dddd0d24a4c0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:14.264262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cf7f5-129c-4c6b-9979-223c6c505de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:14.264886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf7f5-129c-4c6b-9979-223c6c505de6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:14.265158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf7f5-129c-4c6b-9979-223c6c505de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:14.265421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cf7f5-129c-4c6b-9979-223c6c505de6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:14.266599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf7f5-129c-4c6b-9979-223c6c505de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:14.268084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cf7f5-129c-4c6b-9979-223c6c505de6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:14.269626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 411/842] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:14.275834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d264a86-83ae-44a6-837d-11f1d940b348 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:14.311785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:14.380240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d264a86-83ae-44a6-837d-11f1d940b348 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:14.414236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d23da1-c599-432e-a800-1516bd9d0a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:14.414862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23da1-c599-432e-a800-1516bd9d0a21 None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:14.415136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23da1-c599-432e-a800-1516bd9d0a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:14.415402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d23da1-c599-432e-a800-1516bd9d0a21 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:14.416047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d23da1-c599-432e-a800-1516bd9d0a21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:14.417788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d23da1-c599-432e-a800-1516bd9d0a21 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:14.441604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 432/843] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:48:14 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:16.606506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480828-8181-4e82-ac13-2c85da009e4a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:16.607139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480828-8181-4e82-ac13-2c85da009e4a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:16.607139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef480828-8181-4e82-ac13-2c85da009e4a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:16.608403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 412/844] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:16.613844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c9f8b-957c-4e1e-a921-9efa29def3d1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:16.614297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c9f8b-957c-4e1e-a921-9efa29def3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:16.614399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c9f8b-957c-4e1e-a921-9efa29def3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:16.633446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2a1c9f8b-957c-4e1e-a921-9efa29def3d1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:16.634648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2a1c9f8b-957c-4e1e-a921-9efa29def3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:16.706159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 433/845] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:16.970396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480828-8181-4e82-ac13-2c85da009e4a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:17.086184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef480828-8181-4e82-ac13-2c85da009e4a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:17.107113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:17.122755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:17.123423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:17.123716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:17.123984 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] PATH_INFO: `/v3/roles/ba129f3d0c7c49f08f7334bbc914a775` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:17.125455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] RBAC: Authorizing `identity:get_role(role_id=ba129f3d0c7c49f08f7334bbc914a775)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:17.126973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:17.128420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 413/846] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:16 2022] GET /identity/v3/roles/ba129f3d0c7c49f08f7334bbc914a775 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:17.134976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c9f8b-957c-4e1e-a921-9efa29def3d1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:17.159936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:17.238985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c9f8b-957c-4e1e-a921-9efa29def3d1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:17.273959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:17.274599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:17.274900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:17.275153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] PATH_INFO: `/v3/users/43bb241aca6b4eaca775db5e873ead74` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:17.288821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] RBAC: Authorizing `identity:get_user(user_id=43bb241aca6b4eaca775db5e873ead74)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:17.290326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:17.292039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 434/847] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:17 2022] GET /identity/v3/users/43bb241aca6b4eaca775db5e873ead74 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:17.298529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:17.401184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855294a-c5e1-4547-9f4e-c4b4ac11c810 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:17.435801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910df1f-d133-4fd1-8803-12498e14c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:17.436418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910df1f-d133-4fd1-8803-12498e14c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:17.436685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910df1f-d133-4fd1-8803-12498e14c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:17.436940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910df1f-d133-4fd1-8803-12498e14c2b5 None admin] PATH_INFO: `/v3/projects/f3e22ed84d844264ae104ec32daf49a1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:17.438077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910df1f-d133-4fd1-8803-12498e14c2b5 None admin] RBAC: Authorizing `identity:get_project(project_id=f3e22ed84d844264ae104ec32daf49a1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:17.439576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910df1f-d133-4fd1-8803-12498e14c2b5 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:17.441178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 414/848] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:17 2022] GET /identity/v3/projects/f3e22ed84d844264ae104ec32daf49a1 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:17.447406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:17.525761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:17.546574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820a176-2372-4f78-bd7d-c9c61bf9595b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:17.582215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dee55-19e4-4663-b9a1-1723e9224e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:17.582907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dee55-19e4-4663-b9a1-1723e9224e3b None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:17.583181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dee55-19e4-4663-b9a1-1723e9224e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:17.583449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dee55-19e4-4663-b9a1-1723e9224e3b None admin] PATH_INFO: `/v3/projects/f3e22ed84d844264ae104ec32daf49a1/users/43bb241aca6b4eaca775db5e873ead74/roles/ba129f3d0c7c49f08f7334bbc914a775` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:17.585719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dee55-19e4-4663-b9a1-1723e9224e3b None admin] RBAC: Authorizing `identity:create_grant(project_id=f3e22ed84d844264ae104ec32daf49a1, user_id=43bb241aca6b4eaca775db5e873ead74, role_id=ba129f3d0c7c49f08f7334bbc914a775)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:17.587274 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dee55-19e4-4663-b9a1-1723e9224e3b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:17.601969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 435/849] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:48:17 2022] PUT /identity/v3/projects/f3e22ed84d844264ae104ec32daf49a1/users/43bb241aca6b4eaca775db5e873ead74/roles/ba129f3d0c7c49f08f7334bbc914a775 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:48:19.777953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8389-bf19-4b39-9006-539f18069041 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:19.778542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8389-bf19-4b39-9006-539f18069041 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:19.778542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8389-bf19-4b39-9006-539f18069041 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:19.779884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 415/850] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:19.785369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7190-c05e-4096-9f58-3c9a2b914124 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:19.785825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7190-c05e-4096-9f58-3c9a2b914124 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:19.785913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e7190-c05e-4096-9f58-3c9a2b914124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:19.804978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1a2e7190-c05e-4096-9f58-3c9a2b914124 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:19.806230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1a2e7190-c05e-4096-9f58-3c9a2b914124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:19.876278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 436/851] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:20.140457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8389-bf19-4b39-9006-539f18069041 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:20.202397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:20.250242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8389-bf19-4b39-9006-539f18069041 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:20.285189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:20.285809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:20.286075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:20.286336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] PATH_INFO: `/v3/roles/ba129f3d0c7c49f08f7334bbc914a775` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:20.287742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] RBAC: Authorizing `identity:get_role(role_id=ba129f3d0c7c49f08f7334bbc914a775)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:20.289104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:20.290535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 416/852] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:20 2022] GET /identity/v3/roles/ba129f3d0c7c49f08f7334bbc914a775 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:20.297138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e7190-c05e-4096-9f58-3c9a2b914124 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:20.366042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:20.401126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e7190-c05e-4096-9f58-3c9a2b914124 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:20.435855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:20.436472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:20.436702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:20.436986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] PATH_INFO: `/v3/users/43bb241aca6b4eaca775db5e873ead74` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:20.438099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] RBAC: Authorizing `identity:get_user(user_id=43bb241aca6b4eaca775db5e873ead74)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:20.439618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:20.441188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 437/853] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:20 2022] GET /identity/v3/users/43bb241aca6b4eaca775db5e873ead74 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:20.447252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:20.551018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead2a0f-c310-4d5c-8cbc-8da83643229c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:20.574811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:20.587649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:20.588257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:20.588528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:20.588793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:20.660162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:20.661630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:20.765817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 417/854] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:48:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:48:20.772177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:20.877660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459ea12-6058-494d-92d2-7d45ed57a184 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:20.913826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67785e0-c4d2-411a-a80d-45271585fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:20.914476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67785e0-c4d2-411a-a80d-45271585fb6b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:20.914787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67785e0-c4d2-411a-a80d-45271585fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:20.915058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67785e0-c4d2-411a-a80d-45271585fb6b None admin] PATH_INFO: `/v3/projects/f3e22ed84d844264ae104ec32daf49a1` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:20.916182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67785e0-c4d2-411a-a80d-45271585fb6b None admin] RBAC: Authorizing `identity:get_project(project_id=f3e22ed84d844264ae104ec32daf49a1)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:20.917951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67785e0-c4d2-411a-a80d-45271585fb6b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:20.919631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 438/855] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:20 2022] GET /identity/v3/projects/f3e22ed84d844264ae104ec32daf49a1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:20.926173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:20.951803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:21.031943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd9315-70f7-4260-ae39-c0890f9dbbc8 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:21.067761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951fe9-ddca-4d39-9747-c3df542b9eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:21.068355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951fe9-ddca-4d39-9747-c3df542b9eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:21.068627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951fe9-ddca-4d39-9747-c3df542b9eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:21.068893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951fe9-ddca-4d39-9747-c3df542b9eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:21.069613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951fe9-ddca-4d39-9747-c3df542b9eb7 None admin] RBAC: Adding query filter params (role.id=ba129f3d0c7c49f08f7334bbc914a775, scope.project.id=f3e22ed84d844264ae104ec32daf49a1, user.id=43bb241aca6b4eaca775db5e873ead74) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:21.069912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951fe9-ddca-4d39-9747-c3df542b9eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:21.071421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951fe9-ddca-4d39-9747-c3df542b9eb7 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:21.077292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 418/856] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:48:20 2022] GET /identity/v3/role_assignments?user.id=43bb241aca6b4eaca775db5e873ead74&scope.project.id=f3e22ed84d844264ae104ec32daf49a1&role.id=ba129f3d0c7c49f08f7334bbc914a775 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:23.195957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bf44-c079-4e9e-bec1-f438af81d91a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:23.196529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bf44-c079-4e9e-bec1-f438af81d91a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:23.196529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bf44-c079-4e9e-bec1-f438af81d91a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:23.198028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 439/857] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:23.204051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d6587-ce76-4ac3-bc1d-70e85989e6ba None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:23.204506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d6587-ce76-4ac3-bc1d-70e85989e6ba None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:23.204598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d6587-ce76-4ac3-bc1d-70e85989e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:23.225557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5f0d6587-ce76-4ac3-bc1d-70e85989e6ba None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:23.227101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5f0d6587-ce76-4ac3-bc1d-70e85989e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:23.300305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 419/858] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:23.563755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904bf44-c079-4e9e-bec1-f438af81d91a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:23.573672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:23.670175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904bf44-c079-4e9e-bec1-f438af81d91a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:23.704426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ad445-d71d-4142-b806-c98b1efc28a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:23.705077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ad445-d71d-4142-b806-c98b1efc28a0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:23.705345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ad445-d71d-4142-b806-c98b1efc28a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:23.705588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ad445-d71d-4142-b806-c98b1efc28a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:23.706763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ad445-d71d-4142-b806-c98b1efc28a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:23.708177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ad445-d71d-4142-b806-c98b1efc28a0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:23.709764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 440/859] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:23.715904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d6587-ce76-4ac3-bc1d-70e85989e6ba None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:23.735006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:23.939905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d6587-ce76-4ac3-bc1d-70e85989e6ba None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:23.975691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5e09c-afe6-4f9b-a25f-9906111b9cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:23.976333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e09c-afe6-4f9b-a25f-9906111b9cfb None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:23.976604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e09c-afe6-4f9b-a25f-9906111b9cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:23.976939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e09c-afe6-4f9b-a25f-9906111b9cfb None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:23.977590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5e09c-afe6-4f9b-a25f-9906111b9cfb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:23.979082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5e09c-afe6-4f9b-a25f-9906111b9cfb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:24.007689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 420/860] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:48:23 2022] POST /identity/v3/projects => generated 311 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:26.188227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8b4d-4be6-42fe-8715-23cf5a2ac4c3 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:26.188812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8b4d-4be6-42fe-8715-23cf5a2ac4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:26.188812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8b4d-4be6-42fe-8715-23cf5a2ac4c3 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:26.190085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 441/861] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:26.195565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f49d-0a09-4f33-8adc-6d5bb98fc883 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:26.195976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f49d-0a09-4f33-8adc-6d5bb98fc883 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:26.196063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7f49d-0a09-4f33-8adc-6d5bb98fc883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:26.214951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f1e7f49d-0a09-4f33-8adc-6d5bb98fc883 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:26.216115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f1e7f49d-0a09-4f33-8adc-6d5bb98fc883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:26.280466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:26.285388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 421/862] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:26.551608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8b4d-4be6-42fe-8715-23cf5a2ac4c3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:26.628629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:26.655284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8b4d-4be6-42fe-8715-23cf5a2ac4c3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:26.690100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289cd0-001b-48c7-8197-9d6f48f74a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:26.690764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289cd0-001b-48c7-8197-9d6f48f74a75 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:26.691043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289cd0-001b-48c7-8197-9d6f48f74a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:26.691306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289cd0-001b-48c7-8197-9d6f48f74a75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:26.692516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289cd0-001b-48c7-8197-9d6f48f74a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:26.694001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289cd0-001b-48c7-8197-9d6f48f74a75 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:26.695672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 442/863] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:48:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:26.701823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7f49d-0a09-4f33-8adc-6d5bb98fc883 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:26.803952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7f49d-0a09-4f33-8adc-6d5bb98fc883 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:26.839239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1cfdf-8db4-4431-8ed5-8cf4b9dcb0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:26.839875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1cfdf-8db4-4431-8ed5-8cf4b9dcb0cd None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:26.840140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1cfdf-8db4-4431-8ed5-8cf4b9dcb0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:26.840396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1cfdf-8db4-4431-8ed5-8cf4b9dcb0cd None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:26.841048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1cfdf-8db4-4431-8ed5-8cf4b9dcb0cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:26.842485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1cfdf-8db4-4431-8ed5-8cf4b9dcb0cd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:26.865562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 422/864] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:48:26 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:29.046446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5300af-0d49-4430-b317-0eebdefa3b2c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:29.047081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5300af-0d49-4430-b317-0eebdefa3b2c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:29.047081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5300af-0d49-4430-b317-0eebdefa3b2c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:29.048374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 443/865] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:29.053615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf93a6-921c-4691-a395-0787d7aee578 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:29.054044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf93a6-921c-4691-a395-0787d7aee578 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:29.054149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf93a6-921c-4691-a395-0787d7aee578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:29.073580 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a9cf93a6-921c-4691-a395-0787d7aee578 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:29.074796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a9cf93a6-921c-4691-a395-0787d7aee578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:29.129987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:29.148991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 423/866] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:29.425323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5300af-0d49-4430-b317-0eebdefa3b2c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:29.527249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5300af-0d49-4430-b317-0eebdefa3b2c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:29.565886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:29.566511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:29.566817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:29.567083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:29.577231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:48:29.582184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:29.583260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:29.587565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 444/867] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:29.589784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf93a6-921c-4691-a395-0787d7aee578 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:29.692574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf93a6-921c-4691-a395-0787d7aee578 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:29.727556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:29.728157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:29.728430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:29.728686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:29.729342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:29.729634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:29.731029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:29.739367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 424/868] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:29.745596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:29.749176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:29.853680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ac39a-168a-4b64-b006-52cf17c64f82 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:29.889267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:29.889896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:29.890168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:29.890433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] PATH_INFO: `/v3/users/30479cab658845b79140e7faf9929632` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:29.903643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] RBAC: Authorizing `identity:get_user(user_id=30479cab658845b79140e7faf9929632)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:29.905116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:29.906849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 445/869] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:29 2022] GET /identity/v3/users/30479cab658845b79140e7faf9929632 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:29.913056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:29.968435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:30.024804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1a848-65e2-4f33-9e67-2678ea538724 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:30.061944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070c364-ea14-447c-8cb2-7f4adfaea331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:30.062712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070c364-ea14-447c-8cb2-7f4adfaea331 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:30.063026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070c364-ea14-447c-8cb2-7f4adfaea331 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:30.063293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070c364-ea14-447c-8cb2-7f4adfaea331 None admin] PATH_INFO: `/v3/projects/56b09eca555447888f02a80462c47dbc` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:30.064556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070c364-ea14-447c-8cb2-7f4adfaea331 None admin] RBAC: Authorizing `identity:get_project(project_id=56b09eca555447888f02a80462c47dbc)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:30.066116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070c364-ea14-447c-8cb2-7f4adfaea331 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:30.067976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 425/870] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:29 2022] GET /identity/v3/projects/56b09eca555447888f02a80462c47dbc => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:30.074546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:30.139062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:30.182826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f2944-2050-41fa-9a9e-ba1e4d0cad7b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:30.218418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fab541-dffb-4070-8e54-4b09aed94a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:30.219157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fab541-dffb-4070-8e54-4b09aed94a4d None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:30.219380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fab541-dffb-4070-8e54-4b09aed94a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:30.219644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fab541-dffb-4070-8e54-4b09aed94a4d None admin] PATH_INFO: `/v3/projects/56b09eca555447888f02a80462c47dbc/users/30479cab658845b79140e7faf9929632/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:30.221655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fab541-dffb-4070-8e54-4b09aed94a4d None admin] RBAC: Authorizing `identity:create_grant(project_id=56b09eca555447888f02a80462c47dbc, user_id=30479cab658845b79140e7faf9929632, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:30.223156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fab541-dffb-4070-8e54-4b09aed94a4d None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:30.237316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 446/871] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:48:30 2022] PUT /identity/v3/projects/56b09eca555447888f02a80462c47dbc/users/30479cab658845b79140e7faf9929632/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:48:32.357269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e07a-de32-4eb3-8c9c-3017ec8057ae None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:32.358167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e07a-de32-4eb3-8c9c-3017ec8057ae None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:32.358167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e07a-de32-4eb3-8c9c-3017ec8057ae None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:32.360317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 426/872] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:32.366610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6d9e-c25f-46bd-86f1-1f9554cb833e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:32.367100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6d9e-c25f-46bd-86f1-1f9554cb833e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:32.367204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e6d9e-c25f-46bd-86f1-1f9554cb833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:32.393090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-167e6d9e-c25f-46bd-86f1-1f9554cb833e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:32.394298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-167e6d9e-c25f-46bd-86f1-1f9554cb833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:32.465658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 447/873] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:32.728834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9e07a-de32-4eb3-8c9c-3017ec8057ae None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:32.836777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9e07a-de32-4eb3-8c9c-3017ec8057ae None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:32.853385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:32.872527 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:32.873153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:32.873429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:32.873685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:32.884580 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:48:32.889390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:32.890477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:32.891406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 427/874] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:48:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:32.896774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6d9e-c25f-46bd-86f1-1f9554cb833e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:32.948272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:33.002711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e6d9e-c25f-46bd-86f1-1f9554cb833e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:33.039260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:33.039859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:33.040129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:33.040388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:33.041041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:33.041338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:33.043047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:33.052051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 448/875] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:48:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:33.058748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:33.160330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a73b97-4710-4a8b-ac0f-8a4df4cc708a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:33.194374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:33.195009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:33.195298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:33.195556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] PATH_INFO: `/v3/users/30479cab658845b79140e7faf9929632` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:33.196692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=30479cab658845b79140e7faf9929632)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:33.198106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:33.199689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 428/876] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:33 2022] GET /identity/v3/users/30479cab658845b79140e7faf9929632 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:33.205973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:33.311465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434017d5-6a1c-4e3c-8d40-7657ff1b6ce7 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:33.324513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:33.347402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:33.348000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:33.348270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:33.348526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:33.414229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:33.415778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:33.519483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 449/877] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:48:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:48:33.525794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:33.574270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:33.629505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ae2ea-55f0-4f94-8851-a4d0483ec3d9 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:33.663698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c077dc9-7cbf-4f79-82fc-20b82b5059cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:33.664357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077dc9-7cbf-4f79-82fc-20b82b5059cb None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:33.664627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077dc9-7cbf-4f79-82fc-20b82b5059cb None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:33.664886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c077dc9-7cbf-4f79-82fc-20b82b5059cb None admin] PATH_INFO: `/v3/projects/56b09eca555447888f02a80462c47dbc` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:33.666043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c077dc9-7cbf-4f79-82fc-20b82b5059cb None admin] RBAC: Authorizing `identity:get_project(project_id=56b09eca555447888f02a80462c47dbc)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:33.667817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c077dc9-7cbf-4f79-82fc-20b82b5059cb None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:33.669426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 429/878] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:33 2022] GET /identity/v3/projects/56b09eca555447888f02a80462c47dbc => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:33.675796 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:33.690750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:33.779158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc7e2-10fe-48e5-b9a4-e1e2f565a925 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:33.816535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a65aa2-5a0c-4936-9c93-3b822577c35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:33.817181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a65aa2-5a0c-4936-9c93-3b822577c35c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:33.817457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a65aa2-5a0c-4936-9c93-3b822577c35c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:33.817722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a65aa2-5a0c-4936-9c93-3b822577c35c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:33.818468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a65aa2-5a0c-4936-9c93-3b822577c35c None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=56b09eca555447888f02a80462c47dbc, user.id=30479cab658845b79140e7faf9929632) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:33.818809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a65aa2-5a0c-4936-9c93-3b822577c35c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:33.820385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a65aa2-5a0c-4936-9c93-3b822577c35c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:33.826590 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 450/879] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:48:33 2022] GET /identity/v3/role_assignments?user.id=30479cab658845b79140e7faf9929632&scope.project.id=56b09eca555447888f02a80462c47dbc&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:35.965236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb12e9-9650-4807-857f-64b00c264585 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:35.965843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb12e9-9650-4807-857f-64b00c264585 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:35.965843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb12e9-9650-4807-857f-64b00c264585 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:35.967165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 430/880] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:35.972922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc2264-7f1a-4e2b-9b17-2c079f185492 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:35.973421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc2264-7f1a-4e2b-9b17-2c079f185492 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:35.973421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc2264-7f1a-4e2b-9b17-2c079f185492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:35.993421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-45bc2264-7f1a-4e2b-9b17-2c079f185492 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:35.994673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-45bc2264-7f1a-4e2b-9b17-2c079f185492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:36.066693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 451/881] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:36.329636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb12e9-9650-4807-857f-64b00c264585 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:36.436353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb12e9-9650-4807-857f-64b00c264585 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:36.449579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:36.472389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66db57e-4025-4e22-a4c3-8a0ba4a51618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:36.472981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66db57e-4025-4e22-a4c3-8a0ba4a51618 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:36.473253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66db57e-4025-4e22-a4c3-8a0ba4a51618 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:36.473520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66db57e-4025-4e22-a4c3-8a0ba4a51618 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:36.474186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66db57e-4025-4e22-a4c3-8a0ba4a51618 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:36.475593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66db57e-4025-4e22-a4c3-8a0ba4a51618 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:36.493695 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 431/882] 10.222.0.48 () {60 vars in 1138 bytes} [Tue Oct 11 11:48:36 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:38.671750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9785-c318-477c-8fdc-8cabd856736c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:38.672412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9785-c318-477c-8fdc-8cabd856736c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:38.672412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9785-c318-477c-8fdc-8cabd856736c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:38.673679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 452/883] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:38.679445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb22f2-8a03-4e1b-90ed-1ccff7ab92b6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:38.679950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb22f2-8a03-4e1b-90ed-1ccff7ab92b6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:38.680138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb22f2-8a03-4e1b-90ed-1ccff7ab92b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:38.700440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bccb22f2-8a03-4e1b-90ed-1ccff7ab92b6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:38.701719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bccb22f2-8a03-4e1b-90ed-1ccff7ab92b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:38.775314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 432/884] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:39.036093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9785-c318-477c-8fdc-8cabd856736c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:39.046098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:39.141956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9785-c318-477c-8fdc-8cabd856736c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:39.178942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb782d-8ea7-475c-9389-c4e12a464e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:39.179660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb782d-8ea7-475c-9389-c4e12a464e2e None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:39.179937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb782d-8ea7-475c-9389-c4e12a464e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:39.180196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb782d-8ea7-475c-9389-c4e12a464e2e None admin] PATH_INFO: `/v3/domains/7d3b387918194a07b03fe0bee8b8138b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:39.190674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb782d-8ea7-475c-9389-c4e12a464e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d3b387918194a07b03fe0bee8b8138b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:39.192099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb782d-8ea7-475c-9389-c4e12a464e2e None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:39.193680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 453/885] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Oct 11 11:48:39 2022] GET /identity/v3/domains/7d3b387918194a07b03fe0bee8b8138b => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:39.200031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb22f2-8a03-4e1b-90ed-1ccff7ab92b6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:39.312181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb22f2-8a03-4e1b-90ed-1ccff7ab92b6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:39.313647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:39.349253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04939090-ebf6-4ebf-8675-894da97ec125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:39.349845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04939090-ebf6-4ebf-8675-894da97ec125 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:39.350125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04939090-ebf6-4ebf-8675-894da97ec125 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:39.350377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04939090-ebf6-4ebf-8675-894da97ec125 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:39.351057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04939090-ebf6-4ebf-8675-894da97ec125 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:39.352521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04939090-ebf6-4ebf-8675-894da97ec125 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:39.381632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 433/886] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:48:39 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:41.566524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7f36-1e0c-4614-b2a1-fffdabecb785 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:41.567072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7f36-1e0c-4614-b2a1-fffdabecb785 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:41.567072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c7f36-1e0c-4614-b2a1-fffdabecb785 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:41.568504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 454/887] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:41.574020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c5a8-417b-4965-a0bc-19c1ab6f12cc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:41.574462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c5a8-417b-4965-a0bc-19c1ab6f12cc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:41.574579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0c5a8-417b-4965-a0bc-19c1ab6f12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:41.593724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-83a0c5a8-417b-4965-a0bc-19c1ab6f12cc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:41.594953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-83a0c5a8-417b-4965-a0bc-19c1ab6f12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:41.663839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 434/888] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:41.926062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c7f36-1e0c-4614-b2a1-fffdabecb785 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:41.998595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:42.036495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c7f36-1e0c-4614-b2a1-fffdabecb785 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:42.071608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51882f-1dee-41c7-b0d6-9db3070c2d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:42.072310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51882f-1dee-41c7-b0d6-9db3070c2d82 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:42.072459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51882f-1dee-41c7-b0d6-9db3070c2d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:42.072755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51882f-1dee-41c7-b0d6-9db3070c2d82 None admin] PATH_INFO: `/v3/domains/7d3b387918194a07b03fe0bee8b8138b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:42.073927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51882f-1dee-41c7-b0d6-9db3070c2d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d3b387918194a07b03fe0bee8b8138b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:42.075390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51882f-1dee-41c7-b0d6-9db3070c2d82 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:42.076970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 455/889] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Oct 11 11:48:41 2022] GET /identity/v3/domains/7d3b387918194a07b03fe0bee8b8138b => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:42.083120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0c5a8-417b-4965-a0bc-19c1ab6f12cc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:42.172232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:42.189172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0c5a8-417b-4965-a0bc-19c1ab6f12cc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:42.225004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1331e-f85f-4bfb-95f3-9d6b4ffed284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:42.225686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1331e-f85f-4bfb-95f3-9d6b4ffed284 None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:42.225955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1331e-f85f-4bfb-95f3-9d6b4ffed284 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:42.226218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1331e-f85f-4bfb-95f3-9d6b4ffed284 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:42.226922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1331e-f85f-4bfb-95f3-9d6b4ffed284 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:42.228402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1331e-f85f-4bfb-95f3-9d6b4ffed284 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:42.252019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 435/890] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:48:42 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:48:44.427968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1cc7d-29e7-401e-a376-03d0df8363f1 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:44.428533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1cc7d-29e7-401e-a376-03d0df8363f1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:44.428533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1cc7d-29e7-401e-a376-03d0df8363f1 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:44.429971 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 456/891] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:44.435451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65e40-a637-4dc0-9a90-220b01870e6a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:44.435886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65e40-a637-4dc0-9a90-220b01870e6a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:44.435977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65e40-a637-4dc0-9a90-220b01870e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:44.454685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bff65e40-a637-4dc0-9a90-220b01870e6a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:44.455870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bff65e40-a637-4dc0-9a90-220b01870e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:44.526382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 436/892] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:44.794415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1cc7d-29e7-401e-a376-03d0df8363f1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:44.900297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1cc7d-29e7-401e-a376-03d0df8363f1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:44.934439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:44.935095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:44.935366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:44.935628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:44.937604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:44.948111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:48:44.953028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:44.954079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:48:44.954972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 457/893] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:44.960423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65e40-a637-4dc0-9a90-220b01870e6a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:45.030592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:45.065562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65e40-a637-4dc0-9a90-220b01870e6a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:45.101606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:45.102205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:45.102480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:45.102773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:45.103431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:45.103723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:45.105106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:45.113622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 437/894] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:45.119704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:45.223604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3070a1e-2ea2-4836-9951-fccaceaf6fdf None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:45.258047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:45.258713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:45.258995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:45.259262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] PATH_INFO: `/v3/users/5e0e99c5cf564463a9c9c7d2aaa57959` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:45.272702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=5e0e99c5cf564463a9c9c7d2aaa57959)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:45.274221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:45.275872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 458/895] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:45 2022] GET /identity/v3/users/5e0e99c5cf564463a9c9c7d2aaa57959 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:45.281810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:45.392275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13c93f-3693-441a-97c1-6b3907932259 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:45.421703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:45.427902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7c75a-8566-40b6-82cc-54e367ee940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:45.428536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c75a-8566-40b6-82cc-54e367ee940a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:45.428804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c75a-8566-40b6-82cc-54e367ee940a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:45.429066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c75a-8566-40b6-82cc-54e367ee940a None admin] PATH_INFO: `/v3/projects/cccbf103497042b98640318e36ec48f3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:45.430664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7c75a-8566-40b6-82cc-54e367ee940a None admin] RBAC: Authorizing `identity:get_project(project_id=cccbf103497042b98640318e36ec48f3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:45.432095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7c75a-8566-40b6-82cc-54e367ee940a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:45.433724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 438/896] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:45 2022] GET /identity/v3/projects/cccbf103497042b98640318e36ec48f3 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:45.439927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:45.495718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:45.545023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd955d40-668c-4296-a129-e4cb6eb4a2f1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:45.581633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71cf7a-78ac-4a6e-8104-3ff919513b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:45.582285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71cf7a-78ac-4a6e-8104-3ff919513b1b None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:45.582593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71cf7a-78ac-4a6e-8104-3ff919513b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:45.582849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71cf7a-78ac-4a6e-8104-3ff919513b1b None admin] PATH_INFO: `/v3/projects/cccbf103497042b98640318e36ec48f3/users/5e0e99c5cf564463a9c9c7d2aaa57959/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:45.584848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71cf7a-78ac-4a6e-8104-3ff919513b1b None admin] RBAC: Authorizing `identity:create_grant(project_id=cccbf103497042b98640318e36ec48f3, user_id=5e0e99c5cf564463a9c9c7d2aaa57959, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:45.586312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71cf7a-78ac-4a6e-8104-3ff919513b1b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:45.600501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 459/897] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:48:45 2022] PUT /identity/v3/projects/cccbf103497042b98640318e36ec48f3/users/5e0e99c5cf564463a9c9c7d2aaa57959/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:48:47.723033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9028e-7d80-4685-a034-979dbce7d0ab None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:47.723592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9028e-7d80-4685-a034-979dbce7d0ab None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:47.723592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9028e-7d80-4685-a034-979dbce7d0ab None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:47.724924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 439/898] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:48:47.730501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada980-833c-4134-b466-7a88f83763c6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:47.731016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada980-833c-4134-b466-7a88f83763c6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:47.731016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada980-833c-4134-b466-7a88f83763c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:47.750120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6cada980-833c-4134-b466-7a88f83763c6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:48:47.751342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6cada980-833c-4134-b466-7a88f83763c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:48:47.824934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 460/899] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:48:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:48:48.083179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9028e-7d80-4685-a034-979dbce7d0ab None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:48.193535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9028e-7d80-4685-a034-979dbce7d0ab None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:48.229489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:48.230043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:48.230313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:48.230583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:48.241693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:48:48.246523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:48:48.247499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:48:48.248370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 440/900] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:48:48.254275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cada980-833c-4134-b466-7a88f83763c6 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:48.300916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:48.360690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cada980-833c-4134-b466-7a88f83763c6 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:48.396752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:48.397360 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:48.397631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:48.397899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:48.398620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:48.398948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:48.400310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:48.408749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 461/901] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:48.415186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:48.478436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:48.521148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19719a-5cac-48bf-bdb9-d4ab96d7ef3e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:48.557146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:48.557807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:48.558078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:48.558341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] PATH_INFO: `/v3/users/5e0e99c5cf564463a9c9c7d2aaa57959` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:48.559620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] RBAC: Authorizing `identity:get_user(user_id=5e0e99c5cf564463a9c9c7d2aaa57959)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:48.561117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:48.562861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 441/902] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Oct 11 11:48:48 2022] GET /identity/v3/users/5e0e99c5cf564463a9c9c7d2aaa57959 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:48.569176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:48.675827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97e421-1d3f-4679-b2e1-f85f58c09874 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:48.678217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:48.712017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:48.712625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:48.712896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:48.713160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:48.783552 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:48.784910 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:48.887931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 462/903] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:48:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:48:48.894078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:49.002350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17042cd2-896c-4dbb-9c7d-e95ed5ec524e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:49.028512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:49.036943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01633a8-3115-48dd-8f48-f2a089ea8fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:49.037521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01633a8-3115-48dd-8f48-f2a089ea8fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:49.037788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01633a8-3115-48dd-8f48-f2a089ea8fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:49.038050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01633a8-3115-48dd-8f48-f2a089ea8fc4 None admin] PATH_INFO: `/v3/projects/cccbf103497042b98640318e36ec48f3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:49.039185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01633a8-3115-48dd-8f48-f2a089ea8fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=cccbf103497042b98640318e36ec48f3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:49.040664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01633a8-3115-48dd-8f48-f2a089ea8fc4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:49.042699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 442/904] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Oct 11 11:48:48 2022] GET /identity/v3/projects/cccbf103497042b98640318e36ec48f3 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:49.049262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:48:49.052579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:49.153843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b813f-c1ff-4991-8dd5-6e64c94c22c0 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:48:49.189745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d7f36-7a71-401e-8011-7e80b25e3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:48:49.190349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7f36-7a71-401e-8011-7e80b25e3b25 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:48:49.190650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7f36-7a71-401e-8011-7e80b25e3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:48:49.190923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d7f36-7a71-401e-8011-7e80b25e3b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:48:49.191651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7f36-7a71-401e-8011-7e80b25e3b25 None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=cccbf103497042b98640318e36ec48f3, user.id=5e0e99c5cf564463a9c9c7d2aaa57959) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:48:49.191937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7f36-7a71-401e-8011-7e80b25e3b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:48:49.193382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d7f36-7a71-401e-8011-7e80b25e3b25 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:48:49.199459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 463/905] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:48:49 2022] GET /identity/v3/role_assignments?user.id=5e0e99c5cf564463a9c9c7d2aaa57959&scope.project.id=cccbf103497042b98640318e36ec48f3&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:48:59.033482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:48:59.196765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=66 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:47.375525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84fe51-9ef2-41b0-bc93-c2b9dfea5a10 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:47.376343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84fe51-9ef2-41b0-bc93-c2b9dfea5a10 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:47.376723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84fe51-9ef2-41b0-bc93-c2b9dfea5a10 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:47.379960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 443/906] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:49:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:49:47.387908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355034-c341-4dcf-a06b-8a21e6d7dffc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:47.389347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355034-c341-4dcf-a06b-8a21e6d7dffc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:47.390287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355034-c341-4dcf-a06b-8a21e6d7dffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:47.427305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cc355034-c341-4dcf-a06b-8a21e6d7dffc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:49:47.429732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cc355034-c341-4dcf-a06b-8a21e6d7dffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:49:47.571773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 464/907] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:49:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:49:47.860633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84fe51-9ef2-41b0-bc93-c2b9dfea5a10 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:48.061219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84fe51-9ef2-41b0-bc93-c2b9dfea5a10 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:48.109179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:48.109972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:48.110378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:48.110881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:48.128665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:48.130615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:49:48.149102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:48.150243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:49:48.151251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:49:48.151251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:48.151251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:49:48.151251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 444/908] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:49:48.158376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355034-c341-4dcf-a06b-8a21e6d7dffc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:48.321318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355034-c341-4dcf-a06b-8a21e6d7dffc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:48.381344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:48.392311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c1a48-fb8b-4153-a2c3-a4f806292a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:48.393299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1a48-fb8b-4153-a2c3-a4f806292a3b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:48.393715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1a48-fb8b-4153-a2c3-a4f806292a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:48.393991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c1a48-fb8b-4153-a2c3-a4f806292a3b None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:48.395585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c1a48-fb8b-4153-a2c3-a4f806292a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:48.395585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c1a48-fb8b-4153-a2c3-a4f806292a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:48.397433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c1a48-fb8b-4153-a2c3-a4f806292a3b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:48.420935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 465/909] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:48.424052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:48.520761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:48.619237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676a395-aa87-4e67-9a0b-032b3116591e None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:48.676414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3d799-7ad2-4823-9699-1598debee37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:48.677051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3d799-7ad2-4823-9699-1598debee37f None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:48.677795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3d799-7ad2-4823-9699-1598debee37f None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:48.678072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3d799-7ad2-4823-9699-1598debee37f None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:48.678777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3d799-7ad2-4823-9699-1598debee37f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:48.680240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3d799-7ad2-4823-9699-1598debee37f None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:48.720184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 445/910] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Oct 11 11:49:48 2022] POST /identity/v3/users => generated 251 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:49:51.257518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9e50-59d6-4dfd-93ac-130b3dfca77a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:51.258075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9e50-59d6-4dfd-93ac-130b3dfca77a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:51.258261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e9e50-59d6-4dfd-93ac-130b3dfca77a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:51.260106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 466/911] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:49:51.267681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a6e0-07ae-445e-a449-494789841bd9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:51.269639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a6e0-07ae-445e-a449-494789841bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:51.269639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a6e0-07ae-445e-a449-494789841bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:51.304369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d730a6e0-07ae-445e-a449-494789841bd9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:49:51.306991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d730a6e0-07ae-445e-a449-494789841bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:49:51.437676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 446/912] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:49:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:49:51.736966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9e50-59d6-4dfd-93ac-130b3dfca77a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:51.892758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e9e50-59d6-4dfd-93ac-130b3dfca77a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:51.952420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:51.955787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:51.955787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:51.955787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:51.978972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:49:51.985414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:51.986422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:49:51.987835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:49:51.989847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 467/913] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:49:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:49:51.996456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a6e0-07ae-445e-a449-494789841bd9 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:52.054487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:52.143704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a6e0-07ae-445e-a449-494789841bd9 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:52.195396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:52.197035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:52.198107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:52.199057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:52.200294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] RBAC: Adding query filter params (name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:52.200746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:52.204031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:52.220003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 447/914] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:49:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:52.229240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:52.304391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:52.376388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3dcef-de2f-42f7-a701-2a4ac4d791c1 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:52.418231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:52.418934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:52.419199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:52.419520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:52.432495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:52.433986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:49:52.455029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:52.457096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:49:52.458119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:49:52.458119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:52.458119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:49:52.463171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 468/915] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:49:52.465830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:52.623795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:52.629693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de9d79-1700-4c70-b2e1-9eaf73d4085b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:52.692021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:52.692665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:52.692921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:52.693173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:52.693876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:52.694203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:52.696072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:52.711018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 448/916] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:49:52.717317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:52.875071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdaf95-570c-4045-8a14-de0302f52e27 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:52.877307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:52.947568 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:52.948657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:52.949145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:52.949859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] PATH_INFO: `/v3/users/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:52.969291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:52.972089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:49:52.992632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:52.993754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:49:52.994902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:49:52.997099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 469/917] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:49:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:49:53.007696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:53.167969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139ff2-9728-4b24-b980-023c48b938e3 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:53.222439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:53.223279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:53.223643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:53.223914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:53.224721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:53.225058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:53.226596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:53.247751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 449/918] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 11 11:49:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:53.254156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:53.365342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15de2bb-fc35-4ffc-abe3-6678039305af None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:53.402672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:53.403317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:53.403602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:53.403849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:53.417601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:53.419207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:49:53.434667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:53.436931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:49:53.439370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:49:53.439370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:53.439370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:49:53.439370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 470/919] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:49:53.442070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:53.464967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:53.591497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7b28d-07f9-459d-bca0-126830d3d093 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:53.638704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:53.639426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:53.639723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:53.640003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:53.640670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:53.640962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:53.642851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:53.658890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 450/920] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:53.667440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:53.694004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:53.796047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f001c4-4380-4dc9-baa9-4df3442e39ee None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:53.842961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:53.844086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:53.844593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:53.845110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:53.856636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:53.859156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:49:53.879020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:53.880303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:49:53.887770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 471/921] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:49:53.890370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:54.014366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:54.039042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a0453-951e-47cd-a46c-20ebc0799871 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:54.085449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecd689-31dc-40a9-8d2e-710d812b147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:54.086286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd689-31dc-40a9-8d2e-710d812b147a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:54.086736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd689-31dc-40a9-8d2e-710d812b147a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:54.087167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd689-31dc-40a9-8d2e-710d812b147a None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:54.088409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd689-31dc-40a9-8d2e-710d812b147a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:54.088929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd689-31dc-40a9-8d2e-710d812b147a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:54.091347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd689-31dc-40a9-8d2e-710d812b147a None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:54.111277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 451/922] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:54.117954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:54.221874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:54.280012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbe8d7-b4a3-4fa2-a468-c48c471c4804 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:54.323845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f65d6b-52e2-4ce9-92ea-662d8b0d29b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:54.324529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65d6b-52e2-4ce9-92ea-662d8b0d29b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:54.324794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65d6b-52e2-4ce9-92ea-662d8b0d29b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:54.325064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f65d6b-52e2-4ce9-92ea-662d8b0d29b1 None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/bba839bb4641430cb81a78a8d8242a11/roles/e72e1826d36c4a618d9bb4023d8acd93` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:54.341572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f65d6b-52e2-4ce9-92ea-662d8b0d29b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=bba839bb4641430cb81a78a8d8242a11, role_id=e72e1826d36c4a618d9bb4023d8acd93)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:54.343094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f65d6b-52e2-4ce9-92ea-662d8b0d29b1 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:54.370291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 472/923] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:49:54 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/bba839bb4641430cb81a78a8d8242a11/roles/e72e1826d36c4a618d9bb4023d8acd93 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:49:56.768652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35ee6-fe56-4fce-b527-d2fa15565bf6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:56.769200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35ee6-fe56-4fce-b527-d2fa15565bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:56.769200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f35ee6-fe56-4fce-b527-d2fa15565bf6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:56.770544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 452/924] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:49:56.777427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b5050-3a8d-4d65-9ea4-511ee760f0b7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:56.777996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b5050-3a8d-4d65-9ea4-511ee760f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:56.778434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b5050-3a8d-4d65-9ea4-511ee760f0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:56.801069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e21b5050-3a8d-4d65-9ea4-511ee760f0b7 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:49:56.802479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e21b5050-3a8d-4d65-9ea4-511ee760f0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:49:56.900013 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 473/925] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:49:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:49:57.176741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f35ee6-fe56-4fce-b527-d2fa15565bf6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:57.295828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f35ee6-fe56-4fce-b527-d2fa15565bf6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:57.340348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:57.341052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:57.341344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:57.341607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:57.349435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:57.355672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:49:57.360948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:57.362155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:49:57.363071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 453/926] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Oct 11 11:49:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:49:57.368549 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b5050-3a8d-4d65-9ea4-511ee760f0b7 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:57.450196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:57.524600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b5050-3a8d-4d65-9ea4-511ee760f0b7 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:57.585124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:57.586722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:57.587075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:57.587533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:57.588713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] RBAC: Adding query filter params (name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:57.589154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:57.591279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:57.605976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 474/927] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Oct 11 11:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:57.613259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:57.744540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c8fcc-5d96-43ba-a7cd-2dfd818b141a None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:57.795530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:57.796541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:57.796541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:57.796731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:57.809003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:57.810609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:49:57.829802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:57.831035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:49:57.831959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:49:57.831959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:57.831959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:49:57.831959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 454/928] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:49:57.838904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:57.986314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ba5a-e932-4fbd-97fc-48b2776a7967 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:58.008403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:58.032937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:58.033564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:58.033833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:58.034150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:58.034822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:58.035198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:58.036650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:58.056211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 475/929] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:58.063270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:58.130970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:58.200179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532695cd-7b01-4a94-81b4-7d699c1136ef None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:58.252354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:58.253987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:58.254670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:58.255174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:58.272133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:58.274395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:49:58.293301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:58.295413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:49:58.296882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 455/930] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:49:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:49:58.304059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:58.446065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dc041-be9c-4d68-8054-a2a2d3716cae None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:58.489940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:58.490569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:58.490860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:58.491126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:58.491885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:58.492559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:58.494165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:58.519484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 476/931] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 11 11:49:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:58.529955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:58.682293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8b455-50be-409c-9499-0f0eba2bc99c None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:58.694204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:58.723498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:58.724222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:58.724519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:58.724835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:58.836849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:58.838445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:58.973502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 456/932] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:49:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:49:58.980508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:59.022220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:59.114229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587db1-a4fa-4500-8ff1-0c928bbb0d17 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:59.178082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:59.179351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:59.180037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:59.180391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:59.193523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:59.195167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:49:59.213738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:59.214814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:49:59.220758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:49:59.220758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:49:59.220758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:49:59.220758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 477/933] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:49:59.221229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:59.238810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:59.341797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0845c-a84f-41b7-baa0-c8152bfbae4b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:59.387560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:59.388331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:59.388608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:59.388998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:59.389933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:59.390207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:59.391983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:59.405814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 457/934] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:59.415546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:59.541182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:59.564950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd79f9-2512-46fc-a53d-9a4713f64609 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:59.614561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:59.615237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:59.615510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:59.615775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:59.624593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:59.626358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:49:59.644925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:49:59.646173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:49:59.647621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 478/935] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:49:59.653663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:49:59.753988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:49:59.797278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0ce8c-d3fc-4d86-9bce-68a6a1b49db4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:49:59.846141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655bc8c-5f0f-471a-8af4-81646010baa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:49:59.846948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655bc8c-5f0f-471a-8af4-81646010baa6 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:49:59.847109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655bc8c-5f0f-471a-8af4-81646010baa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:49:59.849187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655bc8c-5f0f-471a-8af4-81646010baa6 None admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:49:59.849187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655bc8c-5f0f-471a-8af4-81646010baa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:49:59.849187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655bc8c-5f0f-471a-8af4-81646010baa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:49:59.849791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655bc8c-5f0f-471a-8af4-81646010baa6 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:49:59.863768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 458/936] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:49:59.869987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:00.013437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d978-e1b7-477e-a36c-098c4ad779b8 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:00.068217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a31c-6094-440f-82fb-a73a22dc0171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:00.070041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a31c-6094-440f-82fb-a73a22dc0171 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:00.070740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a31c-6094-440f-82fb-a73a22dc0171 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:00.071558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a31c-6094-440f-82fb-a73a22dc0171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:00.078055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a31c-6094-440f-82fb-a73a22dc0171 None admin] RBAC: Adding query filter params (role.id=e72e1826d36c4a618d9bb4023d8acd93, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=bba839bb4641430cb81a78a8d8242a11) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:00.078595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a31c-6094-440f-82fb-a73a22dc0171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:00.081880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a31c-6094-440f-82fb-a73a22dc0171 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:00.095342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 479/937] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:49:59 2022] GET /identity/v3/role_assignments?user.id=bba839bb4641430cb81a78a8d8242a11&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=e72e1826d36c4a618d9bb4023d8acd93 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:50:02.686567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98772f-fb63-40f9-ad26-d83f05e9e453 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:02.687240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98772f-fb63-40f9-ad26-d83f05e9e453 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:02.687240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98772f-fb63-40f9-ad26-d83f05e9e453 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:02.688448 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 459/938] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:50:02.696419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15455e-9b80-4ae0-b90a-e009a0bd1d20 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:02.697210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15455e-9b80-4ae0-b90a-e009a0bd1d20 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:02.697210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15455e-9b80-4ae0-b90a-e009a0bd1d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:02.718593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fa15455e-9b80-4ae0-b90a-e009a0bd1d20 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:50:02.720218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fa15455e-9b80-4ae0-b90a-e009a0bd1d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:50:02.723842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:02.803265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 480/939] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:50:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:50:03.099379 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98772f-fb63-40f9-ad26-d83f05e9e453 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:03.249506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98772f-fb63-40f9-ad26-d83f05e9e453 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:03.294533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:03.308050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:03.309026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:03.309427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:03.309892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:03.326195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:50:03.331236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:03.335031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:50:03.336135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 460/940] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:03.341066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15455e-9b80-4ae0-b90a-e009a0bd1d20 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:03.496732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15455e-9b80-4ae0-b90a-e009a0bd1d20 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:03.558438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:03.559400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:03.559837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:03.560335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:03.561336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:03.561822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:03.563474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:03.578035 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 481/941] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:03.588153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:03.733570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45869f0-689d-45a1-b198-86aa43eae20b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:03.786149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:03.786803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:03.787088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:03.787398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:03.801365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:03.803534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:50:03.825501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:03.833586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:50:03.834498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:50:03.834498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:03.834498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:50:03.834498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 461/942] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:03.834771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:03.837727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:03.986189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f25e7-69ec-4ef5-92bd-625fc39076ee None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:04.025964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:04.026633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:04.026903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:04.027169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:04.027887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:04.028130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:04.029499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:04.043094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 482/943] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:50:04.052159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:04.115526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:04.198847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f816c-6316-4afc-8ab9-ee515f143216 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:04.258108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:04.259622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:04.260076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:04.260576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:04.272691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:04.274540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:50:04.289282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:04.296070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:50:04.297236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 462/944] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:50:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:50:04.297975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:04.385946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:04.446258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d1f42-bdbe-4e73-9300-ea0d230c4fe4 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:04.488497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:04.489113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:04.489383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:04.489648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:04.490419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:04.490790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:04.492230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:04.512657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 483/945] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 11 11:50:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:04.518724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:04.654132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdeb435-7340-4986-b01b-a9afbd895071 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:04.656686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:04.703274 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:04.703993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:04.704393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:04.704663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:04.717859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:04.719419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:50:04.735107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:04.737149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:50:04.738311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:50:04.738311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:04.738311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:50:04.738311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 463/946] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:50:04.743499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:04.885701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a406c-fd80-42da-a1b0-4666f882b2e3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:04.915225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:04.938278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:04.939115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:04.939373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:04.939634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:04.940292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:04.940624 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:04.942238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:04.954932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 484/947] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:04.961682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:05.098426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba48324-e3b3-4669-9175-8f55f2b8eed4 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:05.144161 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:05.144988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:05.145525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:05.145852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:05.155630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:05.157348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:50:05.174828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:05.175834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:50:05.183165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 464/948] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:05.186459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:05.328051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500b5f2-b6c1-4ec5-895d-b9a7968d0f3c None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:05.381157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae64a-0ad9-4675-928e-25b02c1f0cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:05.382399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae64a-0ad9-4675-928e-25b02c1f0cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:05.382988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae64a-0ad9-4675-928e-25b02c1f0cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:05.383386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae64a-0ad9-4675-928e-25b02c1f0cb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:05.384534 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ae64a-0ad9-4675-928e-25b02c1f0cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:05.385059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ae64a-0ad9-4675-928e-25b02c1f0cb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:05.387115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ae64a-0ad9-4675-928e-25b02c1f0cb2 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:05.406223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 485/949] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:50:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:05.413814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:05.440088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:05.577635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1cd99-d8ca-41da-b736-001b494cf201 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:05.626633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301c30a-a64d-488e-9b64-a6ed87709060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:05.627572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301c30a-a64d-488e-9b64-a6ed87709060 None admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:05.627889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301c30a-a64d-488e-9b64-a6ed87709060 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:05.628328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301c30a-a64d-488e-9b64-a6ed87709060 None admin] PATH_INFO: `/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/bba839bb4641430cb81a78a8d8242a11/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:05.630574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301c30a-a64d-488e-9b64-a6ed87709060 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdeb1af6f5774cc68dd64c5665c178f5, user_id=bba839bb4641430cb81a78a8d8242a11, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:05.632586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301c30a-a64d-488e-9b64-a6ed87709060 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:05.648092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 465/950] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Oct 11 11:50:05 2022] PUT /identity/v3/projects/fdeb1af6f5774cc68dd64c5665c178f5/users/bba839bb4641430cb81a78a8d8242a11/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:50:07.944890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1312-fd40-4058-a98c-ab65642bdf84 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:07.945944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1312-fd40-4058-a98c-ab65642bdf84 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:07.945944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1312-fd40-4058-a98c-ab65642bdf84 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:07.947277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 486/951] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:50:07.952991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe45a-0a37-4291-9262-033a4cf37581 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:07.953569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe45a-0a37-4291-9262-033a4cf37581 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:07.953664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe45a-0a37-4291-9262-033a4cf37581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:07.979916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1aebe45a-0a37-4291-9262-033a4cf37581 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:50:07.981539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1aebe45a-0a37-4291-9262-033a4cf37581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:50:08.089732 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 466/952] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:50:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:50:08.372457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e1312-fd40-4058-a98c-ab65642bdf84 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:08.439071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:08.541293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e1312-fd40-4058-a98c-ab65642bdf84 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:08.604950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:08.605708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:08.606027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:08.606405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:08.622086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 11 11:50:08.627312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:08.628669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:08.629705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 487/953] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Oct 11 11:50:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:08.637495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe45a-0a37-4291-9262-033a4cf37581 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:08.641214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:08.776818 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebe45a-0a37-4291-9262-033a4cf37581 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:08.825889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:08.827005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:08.827478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:08.828007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:08.829522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:08.830233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:08.833415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:08.856536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 467/954] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Oct 11 11:50:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:50:08.857732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:08.984880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:08.987619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e9918-0982-4859-92fc-29c5b13f8234 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:09.035694 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:09.036442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:09.036720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:09.036988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:09.051206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:09.052734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:50:09.072707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:09.073963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:50:09.079912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:50:09.079912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:09.079912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:09.079912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 488/955] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:50:09.080741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:09.175101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:09.219848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7d208-4959-4872-9734-d66e29543897 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:09.260934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:09.261483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:09.261885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:09.262160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:09.262916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:09.263270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:09.264727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:09.279427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 468/956] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:09.286253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:09.398497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c80d9e-63bf-4dd5-9b53-e640610a3df3 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:09.434115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:09.434775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:09.435057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:09.435310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:09.444818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:09.446249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 11 11:50:09.457452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:09.458476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:09.459599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 489/957] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:50:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 11 11:50:09.464732 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:09.605952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858161e-0563-48ba-bbf4-2d0403f18fcd None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:09.643577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:09.655401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:09.656047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:09.656422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:09.656675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:09.657547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:09.657885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:09.659658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:09.679848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 469/958] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 11 11:50:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:09.685813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:09.702378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:09.814254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1148fb1-bc86-406d-b02c-0572e4520f6f None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:09.852602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:09.853250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:09.853576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:09.853906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:09.931327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:09.935598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:09.953043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:10.064561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 490/959] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Oct 11 11:50:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 11 11:50:10.070221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:10.197540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a81ddb-444e-4337-ab79-8dd33406cba1 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:10.239399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:10.240383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:10.240804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:10.241169 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:10.253115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:10.254733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 11 11:50:10.272489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:10.273507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 11 11:50:10.274400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 11 11:50:10.274400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 11 11:50:10.274400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:50:10.274400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 470/960] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:10.280254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:10.389467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f07811-dc90-459e-8f2c-f5c859fbe869 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:10.403405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:10.426521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:10.427126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:10.427395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:10.427657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:10.428334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:10.428612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:10.429967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:10.442236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 491/961] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Oct 11 11:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:10.448306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:10.494080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:10.581579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c958c5a-1f80-4c65-a392-5e2d8749404b None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:10.624351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:10.624996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:10.625268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:10.625582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:10.633473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:10.634992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 11 11:50:10.648026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:10.649137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: ERROR keystone.server.flask.application Oct 11 11:50:10.650075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 471/962] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Oct 11 11:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:10.655677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:10.768574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9262122-c910-4e02-abb7-7ba6ac178013 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:10.807247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15141dfd-c8f0-4779-9ccd-1a9a3de3b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:10.807891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15141dfd-c8f0-4779-9ccd-1a9a3de3b5ae None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:10.808160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15141dfd-c8f0-4779-9ccd-1a9a3de3b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:10.808421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15141dfd-c8f0-4779-9ccd-1a9a3de3b5ae None admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:10.809137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15141dfd-c8f0-4779-9ccd-1a9a3de3b5ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:10.809429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15141dfd-c8f0-4779-9ccd-1a9a3de3b5ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:10.810929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15141dfd-c8f0-4779-9ccd-1a9a3de3b5ae None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:10.825228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 492/963] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Oct 11 11:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:10.831661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:10.937111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:10.945162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d804118-6338-4c9f-b791-2c4963215141 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:10.984514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dd827-5eb6-4e5d-aa08-f654fa24a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:10.985139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd827-5eb6-4e5d-aa08-f654fa24a81d None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:10.985408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd827-5eb6-4e5d-aa08-f654fa24a81d None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:10.985673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dd827-5eb6-4e5d-aa08-f654fa24a81d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:10.986415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dd827-5eb6-4e5d-aa08-f654fa24a81d None admin] RBAC: Adding query filter params (role.id=d32b6669146241ab9d1fda575c016787, scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5, user.id=bba839bb4641430cb81a78a8d8242a11) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:10.986751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dd827-5eb6-4e5d-aa08-f654fa24a81d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:10.988272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dd827-5eb6-4e5d-aa08-f654fa24a81d None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:10.995607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 472/964] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Oct 11 11:50:10 2022] GET /identity/v3/role_assignments?user.id=bba839bb4641430cb81a78a8d8242a11&scope.project.id=fdeb1af6f5774cc68dd64c5665c178f5&role.id=d32b6669146241ab9d1fda575c016787 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:13.176882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7671-296d-47b0-866d-f5fa61b2fbf4 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:13.177425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7671-296d-47b0-866d-f5fa61b2fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:13.177425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7671-296d-47b0-866d-f5fa61b2fbf4 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:13.178881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 493/965] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:50:13.184495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7db8-af8e-436a-b121-9e0a676e4f0a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:13.184933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7db8-af8e-436a-b121-9e0a676e4f0a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:13.185045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7db8-af8e-436a-b121-9e0a676e4f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:13.203547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fcec7db8-af8e-436a-b121-9e0a676e4f0a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:50:13.204714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fcec7db8-af8e-436a-b121-9e0a676e4f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:50:13.272601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 473/966] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:50:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 11 11:50:13.548058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7671-296d-47b0-866d-f5fa61b2fbf4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:13.590947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:13.664662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7671-296d-47b0-866d-f5fa61b2fbf4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:13.700343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:13.700972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:13.701243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:13.701502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:13.702076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:13.703462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:13.712602 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:13.713769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:13.714913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:13.718728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 494/967] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:50:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:13.719830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec7db8-af8e-436a-b121-9e0a676e4f0a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:13.812267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:13.823233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec7db8-af8e-436a-b121-9e0a676e4f0a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:13.861124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a073359-2f6b-4a61-843d-6ffd30e098ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:13.861751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a073359-2f6b-4a61-843d-6ffd30e098ec None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:13.862008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a073359-2f6b-4a61-843d-6ffd30e098ec None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:13.862275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a073359-2f6b-4a61-843d-6ffd30e098ec None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:13.862941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a073359-2f6b-4a61-843d-6ffd30e098ec None admin] RBAC: Adding query filter params (name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:13.863237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a073359-2f6b-4a61-843d-6ffd30e098ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:13.864610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a073359-2f6b-4a61-843d-6ffd30e098ec None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:13.869586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 474/968] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Oct 11 11:50:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 11:50:13.875649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:13.976010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:13.983660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f0b0-bc90-41d1-bbc9-c764eb78a621 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:14.018080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918b990-6a19-4f8b-b69d-0fc8d45ef5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:14.018726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b990-6a19-4f8b-b69d-0fc8d45ef5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:14.019006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b990-6a19-4f8b-b69d-0fc8d45ef5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:14.019274 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b990-6a19-4f8b-b69d-0fc8d45ef5b7 None admin] PATH_INFO: `/v3/services` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:14.019901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b990-6a19-4f8b-b69d-0fc8d45ef5b7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:14.020197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b990-6a19-4f8b-b69d-0fc8d45ef5b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:14.021554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b990-6a19-4f8b-b69d-0fc8d45ef5b7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:14.026216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 495/969] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Oct 11 11:50:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:16.116257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc9b3-3294-4617-a66c-4ad54addeebf None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:16.116799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc9b3-3294-4617-a66c-4ad54addeebf None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:16.116799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfc9b3-3294-4617-a66c-4ad54addeebf None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:16.118112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 475/970] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:50:16.123583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e8dcd-c290-4882-a466-a15057397454 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:16.123988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e8dcd-c290-4882-a466-a15057397454 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:16.124075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e8dcd-c290-4882-a466-a15057397454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:16.143185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d68e8dcd-c290-4882-a466-a15057397454 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:50:16.144366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d68e8dcd-c290-4882-a466-a15057397454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:50:16.217045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 496/971] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:50:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:50:16.477958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfc9b3-3294-4617-a66c-4ad54addeebf None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:16.591893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfc9b3-3294-4617-a66c-4ad54addeebf None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:16.630767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dee6a6-6910-4f14-b017-d1bf976fe97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:16.631508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dee6a6-6910-4f14-b017-d1bf976fe97c None admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:16.631638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dee6a6-6910-4f14-b017-d1bf976fe97c None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:16.631902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dee6a6-6910-4f14-b017-d1bf976fe97c None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:16.632540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dee6a6-6910-4f14-b017-d1bf976fe97c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:16.633904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dee6a6-6910-4f14-b017-d1bf976fe97c None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:16.651524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 476/972] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Oct 11 11:50:16 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:50:18.867097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84b5ba-cb3a-4787-8f62-341f6f17213f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:18.867659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84b5ba-cb3a-4787-8f62-341f6f17213f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:18.867659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84b5ba-cb3a-4787-8f62-341f6f17213f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:18.868967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 497/973] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:50:18.874527 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd12384-627f-4c41-8851-8757aa4f9555 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:18.874939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd12384-627f-4c41-8851-8757aa4f9555 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:18.875087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd12384-627f-4c41-8851-8757aa4f9555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:18.894147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cfd12384-627f-4c41-8851-8757aa4f9555 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:50:18.895377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cfd12384-627f-4c41-8851-8757aa4f9555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:50:18.905295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:18.974579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 477/974] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:50:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:50:19.238576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84b5ba-cb3a-4787-8f62-341f6f17213f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:19.331974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:19.344385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84b5ba-cb3a-4787-8f62-341f6f17213f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:19.380240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:19.380861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:19.381176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:19.381439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:19.382007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:19.383405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:19.392628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:19.393733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:19.394662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 498/975] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:50:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:19.399887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd12384-627f-4c41-8851-8757aa4f9555 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:19.505519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd12384-627f-4c41-8851-8757aa4f9555 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:19.541069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:19.541667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:19.542250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:19.542522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:19.543199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:19.543491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:19.544858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:19.550825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 478/976] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Oct 11 11:50:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:19.557292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:19.667695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4966e-83e7-442b-a523-e167f2fd8a58 None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:19.702260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7fc3c-2373-4cbc-99d7-827f1a8056b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:19.702890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fc3c-2373-4cbc-99d7-827f1a8056b7 None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:19.703164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fc3c-2373-4cbc-99d7-827f1a8056b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:19.703428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7fc3c-2373-4cbc-99d7-827f1a8056b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:19.704124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7fc3c-2373-4cbc-99d7-827f1a8056b7 None admin] RBAC: Adding query filter params (interface=public, service_id=4a5cce58eb7e4c1ea00276819186ad8c, region_id=RegionOne) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:19.704426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7fc3c-2373-4cbc-99d7-827f1a8056b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:19.705782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7fc3c-2373-4cbc-99d7-827f1a8056b7 None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:19.711099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 499/977] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Oct 11 11:50:19 2022] GET /identity/v3/endpoints?service_id=4a5cce58eb7e4c1ea00276819186ad8c&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:19.717040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:19.721150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:19.819501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c2dbc-c998-421c-90b8-e71f01397b31 None admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:19.860159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a3e36-eebc-4d95-8435-cac7c87c7914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:19.860765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3e36-eebc-4d95-8435-cac7c87c7914 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:19.861035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3e36-eebc-4d95-8435-cac7c87c7914 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:19.861292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a3e36-eebc-4d95-8435-cac7c87c7914 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:19.861899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a3e36-eebc-4d95-8435-cac7c87c7914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:19.863302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a3e36-eebc-4d95-8435-cac7c87c7914 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:19.870297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 479/978] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Oct 11 11:50:19 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:50:22.019248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b4b0-ba5b-4a24-a226-b367b8904a7a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:22.019891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b4b0-ba5b-4a24-a226-b367b8904a7a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:22.019891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b4b0-ba5b-4a24-a226-b367b8904a7a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:22.021412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 500/979] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:50:22.027856 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e479f29-7144-4578-9d43-2b2e510bf0c8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:22.028309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e479f29-7144-4578-9d43-2b2e510bf0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:22.028481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e479f29-7144-4578-9d43-2b2e510bf0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:22.049529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4e479f29-7144-4578-9d43-2b2e510bf0c8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:50:22.050901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4e479f29-7144-4578-9d43-2b2e510bf0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:50:22.117413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:22.123772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 480/980] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:50:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 11 11:50:22.386103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b4b0-ba5b-4a24-a226-b367b8904a7a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:22.408275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:22.496289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b4b0-ba5b-4a24-a226-b367b8904a7a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:22.531502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:22.532189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:22.532467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:22.532731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:22.533369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:22.534827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 11 11:50:22.544743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 11 11:50:22.546651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.get_or_create( Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application with Lock( Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self._enter() Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application return self.creator() Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application created_value = creator( Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: ERROR keystone.server.flask.application Oct 11 11:50:22.548379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 501/981] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 11 11:50:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 11 11:50:22.552628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e479f29-7144-4578-9d43-2b2e510bf0c8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:22.668564 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e479f29-7144-4578-9d43-2b2e510bf0c8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:22.705677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb6065-dcf3-458e-8a32-239dca2d90d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:22.706285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb6065-dcf3-458e-8a32-239dca2d90d3 None admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:22.706570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb6065-dcf3-458e-8a32-239dca2d90d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:22.706847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb6065-dcf3-458e-8a32-239dca2d90d3 None admin] PATH_INFO: `/v3/services` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:22.707482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb6065-dcf3-458e-8a32-239dca2d90d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:50:22.707799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb6065-dcf3-458e-8a32-239dca2d90d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:22.709328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb6065-dcf3-458e-8a32-239dca2d90d3 None admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:22.714832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 481/982] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Oct 11 11:50:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:50:22.720775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:50:22.807652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:22.827553 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d3202-ab41-449c-b18b-1272b352367b None admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:50:22.863544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decd9e2-6cac-4ae6-b2c9-0a1c066528ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:50:22.864146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd9e2-6cac-4ae6-b2c9-0a1c066528ac None admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:50:22.864417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd9e2-6cac-4ae6-b2c9-0a1c066528ac None admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:50:22.864677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decd9e2-6cac-4ae6-b2c9-0a1c066528ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:50:22.865429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decd9e2-6cac-4ae6-b2c9-0a1c066528ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:50:22.866807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decd9e2-6cac-4ae6-b2c9-0a1c066528ac None admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:50:22.889487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 502/983] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:50:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 11:50:32.712142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=69 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:50:32.884433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:30.939776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9097-ea0c-4e18-b05c-980235a7f4b2 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:30.941221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9097-ea0c-4e18-b05c-980235a7f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:30.941905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9097-ea0c-4e18-b05c-980235a7f4b2 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:30.953804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9d34e-28e2-4bcb-af82-23633babef05 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:30.954993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9d34e-28e2-4bcb-af82-23633babef05 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:30.955426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9d34e-28e2-4bcb-af82-23633babef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:30.961922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 482/984] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:30 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:31.084803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-dbe9d34e-28e2-4bcb-af82-23633babef05 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:31.086894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dbe9d34e-28e2-4bcb-af82-23633babef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:31.339177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 503/985] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:31.624096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ddc2-64ef-41e2-9348-e52470cd9d1a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:31.624384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ddc2-64ef-41e2-9348-e52470cd9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:31.624629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757ddc2-64ef-41e2-9348-e52470cd9d1a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:31.626020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 483/986] 10.222.0.48 () {54 vars in 964 bytes} [Tue Oct 11 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:51:31.636207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b845f-dff0-43d4-9018-ebd9a51e5b16 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:31.636476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b845f-dff0-43d4-9018-ebd9a51e5b16 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:31.636748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b845f-dff0-43d4-9018-ebd9a51e5b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:31.741067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4b5b845f-dff0-43d4-9018-ebd9a51e5b16 None None] MFA Rules not processed for user `985db5d7ded74dbeaa8fae4515fea049`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:31.742290 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4b5b845f-dff0-43d4-9018-ebd9a51e5b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:31.766467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:31.832298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 504/987] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Oct 11 11:51:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:31.842060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ddc2-64ef-41e2-9348-e52470cd9d1a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:31.844560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1757ddc2-64ef-41e2-9348-e52470cd9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:31.986355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757ddc2-64ef-41e2-9348-e52470cd9d1a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:32.085912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e2f5-61eb-4b16-b450-bc7eeb34741e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:32.086763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e2f5-61eb-4b16-b450-bc7eeb34741e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:32.087151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e2f5-61eb-4b16-b450-bc7eeb34741e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:32.087519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e2f5-61eb-4b16-b450-bc7eeb34741e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:32.090174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bcd4e2f5-61eb-4b16-b450-bc7eeb34741e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:32.161118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:32.241021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e2f5-61eb-4b16-b450-bc7eeb34741e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:32.242384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e2f5-61eb-4b16-b450-bc7eeb34741e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:32.264898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 484/988] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:34.777440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85435432-e52f-47a9-8e03-e0fa2aba1d3b None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:34.778111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85435432-e52f-47a9-8e03-e0fa2aba1d3b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:34.778111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85435432-e52f-47a9-8e03-e0fa2aba1d3b None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:34.779387 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 505/989] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:34.784920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153c25-6e03-455a-bfe5-a34e396cfd8a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:34.785447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153c25-6e03-455a-bfe5-a34e396cfd8a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:34.785552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153c25-6e03-455a-bfe5-a34e396cfd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:34.875392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-03153c25-6e03-455a-bfe5-a34e396cfd8a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:34.876622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-03153c25-6e03-455a-bfe5-a34e396cfd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:34.986575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 485/990] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:35.288966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7136f-f15b-4143-9ab6-d61786a8424f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:35.289358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7136f-f15b-4143-9ab6-d61786a8424f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:35.289695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7136f-f15b-4143-9ab6-d61786a8424f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:35.291216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 506/991] 10.222.0.48 () {54 vars in 964 bytes} [Tue Oct 11 11:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:35.298366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041a5d-f1de-43c9-9d3e-1c80c104d646 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:35.298689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041a5d-f1de-43c9-9d3e-1c80c104d646 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:35.298982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041a5d-f1de-43c9-9d3e-1c80c104d646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:35.316804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:35.398709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-94041a5d-f1de-43c9-9d3e-1c80c104d646 None None] MFA Rules not processed for user `985db5d7ded74dbeaa8fae4515fea049`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:35.399965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-94041a5d-f1de-43c9-9d3e-1c80c104d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:35.486450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 486/992] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Oct 11 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:35.495969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7136f-f15b-4143-9ab6-d61786a8424f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:35.497579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-19e7136f-f15b-4143-9ab6-d61786a8424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:35.614207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7136f-f15b-4143-9ab6-d61786a8424f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:35.691345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:35.694024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf5e46-26ae-416e-88ab-34a0b0294bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:35.694937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5e46-26ae-416e-88ab-34a0b0294bca service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:35.695212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5e46-26ae-416e-88ab-34a0b0294bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:35.695487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5e46-26ae-416e-88ab-34a0b0294bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:35.697736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9caf5e46-26ae-416e-88ab-34a0b0294bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:35.816909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf5e46-26ae-416e-88ab-34a0b0294bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:35.818261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf5e46-26ae-416e-88ab-34a0b0294bca service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:35.839352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 507/993] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:38.540232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02d398-6de0-467e-b0b4-015fcdccb429 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:38.540910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02d398-6de0-467e-b0b4-015fcdccb429 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:38.540910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02d398-6de0-467e-b0b4-015fcdccb429 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:38.542502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 487/994] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:38.548475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4e5e3-6601-4cb8-bb90-0895665948af None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:38.548974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4e5e3-6601-4cb8-bb90-0895665948af None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:38.548974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4e5e3-6601-4cb8-bb90-0895665948af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:38.622938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-32e4e5e3-6601-4cb8-bb90-0895665948af None None] MFA Rules not processed for user `d0b7084b60b8461287445edf952b32c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:38.624067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-32e4e5e3-6601-4cb8-bb90-0895665948af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:38.679362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:38.728040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 508/995] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:39.005421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02d398-6de0-467e-b0b4-015fcdccb429 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:39.006982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2e02d398-6de0-467e-b0b4-015fcdccb429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:39.119890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02d398-6de0-467e-b0b4-015fcdccb429 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:39.122796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:39.213909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7568e-6f0f-4488-b9e0-cf9db499878f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:39.214525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7568e-6f0f-4488-b9e0-cf9db499878f service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:39.214822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7568e-6f0f-4488-b9e0-cf9db499878f service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:39.215085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7568e-6f0f-4488-b9e0-cf9db499878f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:39.216704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6cf7568e-6f0f-4488-b9e0-cf9db499878f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:39.336014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7568e-6f0f-4488-b9e0-cf9db499878f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:39.337473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7568e-6f0f-4488-b9e0-cf9db499878f service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:39.361952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 488/996] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:42.092086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb81e9a-100b-4771-acdf-34136f18fbdd None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:42.092631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb81e9a-100b-4771-acdf-34136f18fbdd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:42.092631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb81e9a-100b-4771-acdf-34136f18fbdd None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:42.093954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 509/997] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:42.099906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21a887-f7eb-4673-9f74-8ab824b9f15e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:42.100412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21a887-f7eb-4673-9f74-8ab824b9f15e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:42.100412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21a887-f7eb-4673-9f74-8ab824b9f15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:42.144930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:42.172022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7f21a887-f7eb-4673-9f74-8ab824b9f15e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:42.173274 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7f21a887-f7eb-4673-9f74-8ab824b9f15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:42.279137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 489/998] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:42.559568 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb81e9a-100b-4771-acdf-34136f18fbdd None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:42.561209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ceb81e9a-100b-4771-acdf-34136f18fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:42.670225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb81e9a-100b-4771-acdf-34136f18fbdd None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:42.751680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8094-b53c-4b27-becf-fbc28a1f518a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:42.752302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8094-b53c-4b27-becf-fbc28a1f518a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:42.752574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8094-b53c-4b27-becf-fbc28a1f518a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:42.752830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8094-b53c-4b27-becf-fbc28a1f518a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:42.754592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a7ee8094-b53c-4b27-becf-fbc28a1f518a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:42.762098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:42.877774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee8094-b53c-4b27-becf-fbc28a1f518a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:42.879996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee8094-b53c-4b27-becf-fbc28a1f518a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:42.904531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 510/999] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:45.810972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a74b-4a26-4f79-8d19-de70b84c6685 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:45.811522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a74b-4a26-4f79-8d19-de70b84c6685 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:45.811522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a74b-4a26-4f79-8d19-de70b84c6685 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:45.812957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 490/1000] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:45.819301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316abf-aa3b-49f7-a4cf-fae0d5b8e0a7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:45.819877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316abf-aa3b-49f7-a4cf-fae0d5b8e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:45.819877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316abf-aa3b-49f7-a4cf-fae0d5b8e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:45.889568 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2e316abf-aa3b-49f7-a4cf-fae0d5b8e0a7 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:45.890794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2e316abf-aa3b-49f7-a4cf-fae0d5b8e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:45.964073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:46.014204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 511/1001] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:46.295287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a74b-4a26-4f79-8d19-de70b84c6685 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:46.296983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7243a74b-4a26-4f79-8d19-de70b84c6685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:46.410609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a74b-4a26-4f79-8d19-de70b84c6685 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:46.424469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:46.499024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be0dad-1a2f-4e3c-905e-7ef02db3dc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:46.499664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be0dad-1a2f-4e3c-905e-7ef02db3dc08 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:46.499950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be0dad-1a2f-4e3c-905e-7ef02db3dc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:46.500182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be0dad-1a2f-4e3c-905e-7ef02db3dc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:46.501950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-70be0dad-1a2f-4e3c-905e-7ef02db3dc08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:46.630163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be0dad-1a2f-4e3c-905e-7ef02db3dc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:46.631591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be0dad-1a2f-4e3c-905e-7ef02db3dc08 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:46.652018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 491/1002] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:49.079994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49731-da41-4fd6-9fd6-68c4819c0d55 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:49.080514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49731-da41-4fd6-9fd6-68c4819c0d55 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:49.080514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d49731-da41-4fd6-9fd6-68c4819c0d55 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:49.082387 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 512/1003] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:49.088077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b11c7-73f1-445e-b8ba-28ea35acba8a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:49.088611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b11c7-73f1-445e-b8ba-28ea35acba8a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:49.088611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b11c7-73f1-445e-b8ba-28ea35acba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:49.151031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:49.173868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bf4b11c7-73f1-445e-b8ba-28ea35acba8a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:49.175208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bf4b11c7-73f1-445e-b8ba-28ea35acba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:49.278641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 492/1004] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:49.556379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d49731-da41-4fd6-9fd6-68c4819c0d55 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:49.558260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-14d49731-da41-4fd6-9fd6-68c4819c0d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:49.681447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d49731-da41-4fd6-9fd6-68c4819c0d55 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:49.765632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ba1fe-697d-4ba2-831c-84c5718aa7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:49.766246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba1fe-697d-4ba2-831c-84c5718aa7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:49.766523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba1fe-697d-4ba2-831c-84c5718aa7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:49.766813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba1fe-697d-4ba2-831c-84c5718aa7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:49.768443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-099ba1fe-697d-4ba2-831c-84c5718aa7c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:49.786753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:49.882627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba1fe-697d-4ba2-831c-84c5718aa7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:49.883981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba1fe-697d-4ba2-831c-84c5718aa7c6 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:49.903117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 513/1005] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:52.260382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65c98-06ca-4442-9ec1-4e4e9b91d0bc None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:52.260946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65c98-06ca-4442-9ec1-4e4e9b91d0bc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:52.260946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f65c98-06ca-4442-9ec1-4e4e9b91d0bc None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:52.262260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 493/1006] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:51:52.268700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828388cb-1eec-4450-9f6e-e4bb35b33391 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:52.269288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828388cb-1eec-4450-9f6e-e4bb35b33391 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:52.269288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828388cb-1eec-4450-9f6e-e4bb35b33391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:52.354389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-828388cb-1eec-4450-9f6e-e4bb35b33391 None None] MFA Rules not processed for user `d0b7084b60b8461287445edf952b32c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:52.355804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-828388cb-1eec-4450-9f6e-e4bb35b33391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:52.453745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:52.498282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 514/1007] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:52.793973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f65c98-06ca-4442-9ec1-4e4e9b91d0bc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:52.796046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-49f65c98-06ca-4442-9ec1-4e4e9b91d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:52.938790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f65c98-06ca-4442-9ec1-4e4e9b91d0bc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:52.969101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:53.044080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cfe41-8733-4ee7-b90d-716580747972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:53.044635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cfe41-8733-4ee7-b90d-716580747972 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:53.044907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cfe41-8733-4ee7-b90d-716580747972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:53.045168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cfe41-8733-4ee7-b90d-716580747972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:53.046896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f09cfe41-8733-4ee7-b90d-716580747972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:53.218581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cfe41-8733-4ee7-b90d-716580747972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:53.221392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cfe41-8733-4ee7-b90d-716580747972 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:53.257485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 494/1008] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:55.880203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa1f1-7b32-4ed9-b568-d89e0d83b627 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:55.880820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa1f1-7b32-4ed9-b568-d89e0d83b627 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:55.880820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa1f1-7b32-4ed9-b568-d89e0d83b627 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:55.882144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 515/1009] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:55.887668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af9f3-fbce-465f-a9f4-33e62933f7ad None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:55.888098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af9f3-fbce-465f-a9f4-33e62933f7ad None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:55.888185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5af9f3-fbce-465f-a9f4-33e62933f7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:55.965315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:55.968571 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7e5af9f3-fbce-465f-a9f4-33e62933f7ad None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:55.970230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7e5af9f3-fbce-465f-a9f4-33e62933f7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:56.086374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 495/1010] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:56.365007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa1f1-7b32-4ed9-b568-d89e0d83b627 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:56.366675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8bfaa1f1-7b32-4ed9-b568-d89e0d83b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:56.479642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaa1f1-7b32-4ed9-b568-d89e0d83b627 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:56.558807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c8ca-e305-4c95-b3c9-19c6a7e66ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:56.559405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c8ca-e305-4c95-b3c9-19c6a7e66ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:56.559674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c8ca-e305-4c95-b3c9-19c6a7e66ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:56.559937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c8ca-e305-4c95-b3c9-19c6a7e66ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:56.561566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-66b8c8ca-e305-4c95-b3c9-19c6a7e66ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:56.588952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:56.677916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8c8ca-e305-4c95-b3c9-19c6a7e66ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:56.679380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8c8ca-e305-4c95-b3c9-19c6a7e66ef4 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:56.698894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 516/1011] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:51:58.937647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2683-2371-4036-93fa-e94bbae097b8 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:58.938293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2683-2371-4036-93fa-e94bbae097b8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:58.938293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2683-2371-4036-93fa-e94bbae097b8 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:58.939788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 496/1012] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:51:58.946517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254cb0a-0bb9-4607-a358-2140c9503e83 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:58.947028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254cb0a-0bb9-4607-a358-2140c9503e83 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:58.947140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254cb0a-0bb9-4607-a358-2140c9503e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:59.035228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4254cb0a-0bb9-4607-a358-2140c9503e83 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:51:59.036459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4254cb0a-0bb9-4607-a358-2140c9503e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:59.123944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:59.149216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 517/1013] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:51:59.442672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c2683-2371-4036-93fa-e94bbae097b8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:51:59.444212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bd4c2683-2371-4036-93fa-e94bbae097b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:59.557416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c2683-2371-4036-93fa-e94bbae097b8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:51:59.588205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:51:59.636246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce95c-9330-4941-bce2-f614e08db10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:51:59.636886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce95c-9330-4941-bce2-f614e08db10f service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:51:59.637167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce95c-9330-4941-bce2-f614e08db10f service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:51:59.637433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce95c-9330-4941-bce2-f614e08db10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:51:59.639183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ce8ce95c-9330-4941-bce2-f614e08db10f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:51:59.754733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ce95c-9330-4941-bce2-f614e08db10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:51:59.756093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ce95c-9330-4941-bce2-f614e08db10f service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:51:59.775042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 497/1014] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:02.425154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec9d0-4294-45fa-aac3-5a3e3e9fa1a4 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:02.425755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec9d0-4294-45fa-aac3-5a3e3e9fa1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:02.425755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec9d0-4294-45fa-aac3-5a3e3e9fa1a4 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:02.427075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 518/1015] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:02.432689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd017-1afb-4ec0-bda7-ea0da3ed360c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:02.433179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd017-1afb-4ec0-bda7-ea0da3ed360c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:02.433179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd017-1afb-4ec0-bda7-ea0da3ed360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:02.504859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7ddfd017-1afb-4ec0-bda7-ea0da3ed360c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:02.506097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7ddfd017-1afb-4ec0-bda7-ea0da3ed360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:02.515638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:02.616736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 498/1016] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:02.901249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec9d0-4294-45fa-aac3-5a3e3e9fa1a4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:02.902913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e57ec9d0-4294-45fa-aac3-5a3e3e9fa1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:03.019943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec9d0-4294-45fa-aac3-5a3e3e9fa1a4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:03.095208 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a794b2f-6b74-4354-9a4d-23e00f405da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:03.095788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794b2f-6b74-4354-9a4d-23e00f405da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:03.096086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794b2f-6b74-4354-9a4d-23e00f405da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:03.096334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a794b2f-6b74-4354-9a4d-23e00f405da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:03.098040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1a794b2f-6b74-4354-9a4d-23e00f405da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:03.137354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:03.218336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a794b2f-6b74-4354-9a4d-23e00f405da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:03.219829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a794b2f-6b74-4354-9a4d-23e00f405da7 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:03.239315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 519/1017] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:07.545831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c03a5-56ec-4cfa-88c5-75407fa694fa None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:07.546437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c03a5-56ec-4cfa-88c5-75407fa694fa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:07.546437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c03a5-56ec-4cfa-88c5-75407fa694fa None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:07.547867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 499/1018] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:07.554058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778195-4bee-4ca7-93b9-1258ec940de0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:07.555213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778195-4bee-4ca7-93b9-1258ec940de0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:07.555213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778195-4bee-4ca7-93b9-1258ec940de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:07.657810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e6778195-4bee-4ca7-93b9-1258ec940de0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:07.659110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e6778195-4bee-4ca7-93b9-1258ec940de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:07.765038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:07.778343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 520/1019] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:08.066790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c03a5-56ec-4cfa-88c5-75407fa694fa None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:08.068521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-544c03a5-56ec-4cfa-88c5-75407fa694fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:08.196854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c03a5-56ec-4cfa-88c5-75407fa694fa None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:08.247618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:08.288299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc5dfb-6641-45a3-9f52-93af13dcd65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:08.288912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5dfb-6641-45a3-9f52-93af13dcd65f service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:08.289192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5dfb-6641-45a3-9f52-93af13dcd65f service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:08.289456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc5dfb-6641-45a3-9f52-93af13dcd65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:08.291128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-93fc5dfb-6641-45a3-9f52-93af13dcd65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:08.411430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc5dfb-6641-45a3-9f52-93af13dcd65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:08.412867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc5dfb-6641-45a3-9f52-93af13dcd65f service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:08.432882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 500/1020] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 11:52:11.207301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ad3f-b596-4e52-8a54-25d0aa5d91d0 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:11.207860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ad3f-b596-4e52-8a54-25d0aa5d91d0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:11.207860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055ad3f-b596-4e52-8a54-25d0aa5d91d0 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:11.209190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 521/1021] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:11.215603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42a0-b566-4151-b75b-354c6948d8d4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:11.216154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42a0-b566-4151-b75b-354c6948d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:11.216154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42a0-b566-4151-b75b-354c6948d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:11.292624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-719f42a0-b566-4151-b75b-354c6948d8d4 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:11.294082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-719f42a0-b566-4151-b75b-354c6948d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:11.316646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:11.429848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 501/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:11.728786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ad3f-b596-4e52-8a54-25d0aa5d91d0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:11.730337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b055ad3f-b596-4e52-8a54-25d0aa5d91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:11.860070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055ad3f-b596-4e52-8a54-25d0aa5d91d0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:11.950143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55ee4-7a6e-4a72-bd21-80da8cab861c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:11.950800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55ee4-7a6e-4a72-bd21-80da8cab861c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:11.951073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55ee4-7a6e-4a72-bd21-80da8cab861c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:11.951339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55ee4-7a6e-4a72-bd21-80da8cab861c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:11.953029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b9e55ee4-7a6e-4a72-bd21-80da8cab861c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:12.010637 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:12.083299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55ee4-7a6e-4a72-bd21-80da8cab861c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:12.084682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55ee4-7a6e-4a72-bd21-80da8cab861c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:12.105688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 522/1023] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:16.547134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630cdc-6f21-4dca-8c34-3006e4487024 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:16.547653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630cdc-6f21-4dca-8c34-3006e4487024 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:16.547653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630cdc-6f21-4dca-8c34-3006e4487024 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:16.548993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 502/1024] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:16.555110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c55c-0713-4f4c-b8ca-e472edcd1289 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:16.555666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c55c-0713-4f4c-b8ca-e472edcd1289 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:16.555666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c55c-0713-4f4c-b8ca-e472edcd1289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:16.643774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5619c55c-0713-4f4c-b8ca-e472edcd1289 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:16.645028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5619c55c-0713-4f4c-b8ca-e472edcd1289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:16.760432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:16.762973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 523/1025] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:17.039032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0630cdc-6f21-4dca-8c34-3006e4487024 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:17.040556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d0630cdc-6f21-4dca-8c34-3006e4487024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:17.157464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0630cdc-6f21-4dca-8c34-3006e4487024 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:17.216570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:17.245233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed6d1-385f-4c15-8c5e-4d6391e2b40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:17.245916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed6d1-385f-4c15-8c5e-4d6391e2b40c service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:17.246173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed6d1-385f-4c15-8c5e-4d6391e2b40c service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:17.246435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed6d1-385f-4c15-8c5e-4d6391e2b40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:17.248208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-85aed6d1-385f-4c15-8c5e-4d6391e2b40c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:17.377375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed6d1-385f-4c15-8c5e-4d6391e2b40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:17.378896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed6d1-385f-4c15-8c5e-4d6391e2b40c service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:17.398405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 503/1026] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:22.957826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb41730-8c12-4df5-aa2b-8246eb9e687e None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:22.958657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb41730-8c12-4df5-aa2b-8246eb9e687e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:22.958657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb41730-8c12-4df5-aa2b-8246eb9e687e None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:22.959866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 524/1027] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 11:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:22.967180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a746ff-1a20-4f2a-89f3-563dc9442c99 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:22.967955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a746ff-1a20-4f2a-89f3-563dc9442c99 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:22.967955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a746ff-1a20-4f2a-89f3-563dc9442c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:23.114371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-38a746ff-1a20-4f2a-89f3-563dc9442c99 None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:23.117799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-38a746ff-1a20-4f2a-89f3-563dc9442c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:23.161648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:23.316723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 504/1028] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 11:52:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:28.690065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5441c-d39e-4ffb-8f7d-e54644022c03 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:28.690944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5441c-d39e-4ffb-8f7d-e54644022c03 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:28.691442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5441c-d39e-4ffb-8f7d-e54644022c03 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:28.692907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 525/1029] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 11:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:28.698547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec5854-9da6-4b29-afba-31d8aee265e5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:28.699055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec5854-9da6-4b29-afba-31d8aee265e5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:28.699265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec5854-9da6-4b29-afba-31d8aee265e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:28.787188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-90ec5854-9da6-4b29-afba-31d8aee265e5 None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:28.788405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-90ec5854-9da6-4b29-afba-31d8aee265e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:28.870413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:28.929428 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 505/1030] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:30.117812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49896ca3-42e7-4db4-b662-18c99c0398a0 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:30.118323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49896ca3-42e7-4db4-b662-18c99c0398a0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:30.118323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49896ca3-42e7-4db4-b662-18c99c0398a0 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:30.119803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 526/1031] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 11:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:30.125081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237799c-aed8-41eb-96a0-0c1af0746b3a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:30.125604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237799c-aed8-41eb-96a0-0c1af0746b3a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:30.125696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237799c-aed8-41eb-96a0-0c1af0746b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:30.227123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3237799c-aed8-41eb-96a0-0c1af0746b3a None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:30.227758 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3237799c-aed8-41eb-96a0-0c1af0746b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:30.362609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 506/1032] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:52:35.156488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e30f-aed6-4d56-95ed-b1c5f244b9cd None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:35.157071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e30f-aed6-4d56-95ed-b1c5f244b9cd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:35.157071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067e30f-aed6-4d56-95ed-b1c5f244b9cd None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:35.158475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 527/1033] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:35.164899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0e77a-f3a4-453d-ad35-2f74a95713f4 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:35.166499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0e77a-f3a4-453d-ad35-2f74a95713f4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:35.166499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0e77a-f3a4-453d-ad35-2f74a95713f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:35.229115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:35.277094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-14d0e77a-f3a4-453d-ad35-2f74a95713f4 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:35.278239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-14d0e77a-f3a4-453d-ad35-2f74a95713f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:35.409299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 507/1034] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:35.717934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f2f1-0590-404a-a20b-54b22475ca22 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:35.718842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f2f1-0590-404a-a20b-54b22475ca22 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:35.719341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70f2f1-0590-404a-a20b-54b22475ca22 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:35.721084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 528/1035] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 11 11:52:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:52:35.731661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d52062-4b58-4284-bdca-eb26e0673829 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:35.732449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d52062-4b58-4284-bdca-eb26e0673829 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:35.732975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d52062-4b58-4284-bdca-eb26e0673829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:35.843199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-04d52062-4b58-4284-bdca-eb26e0673829 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:35.844614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-04d52062-4b58-4284-bdca-eb26e0673829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:35.897613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:35.984704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 508/1036] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 11 11:52:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:52:35.993474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70f2f1-0590-404a-a20b-54b22475ca22 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:35.996367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cd70f2f1-0590-404a-a20b-54b22475ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:36.238253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70f2f1-0590-404a-a20b-54b22475ca22 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:36.337251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:36.391495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced6fca-ab00-4c39-86bf-5361e23ff882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:36.392363 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6fca-ab00-4c39-86bf-5361e23ff882 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:36.392797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6fca-ab00-4c39-86bf-5361e23ff882 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:36.393252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced6fca-ab00-4c39-86bf-5361e23ff882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:36.395702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6ced6fca-ab00-4c39-86bf-5361e23ff882 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:36.523975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced6fca-ab00-4c39-86bf-5361e23ff882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:36.526043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced6fca-ab00-4c39-86bf-5361e23ff882 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:36.550416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 529/1037] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 11:52:39.071963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19760bb-3527-4639-a604-ed3f48de6771 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:39.072495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19760bb-3527-4639-a604-ed3f48de6771 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:39.072495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19760bb-3527-4639-a604-ed3f48de6771 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:39.074109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 509/1038] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:39.079866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c4ccf-0583-4bf3-bf76-b3b81d3f5d5d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:39.080503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c4ccf-0583-4bf3-bf76-b3b81d3f5d5d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:39.080503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c4ccf-0583-4bf3-bf76-b3b81d3f5d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:39.176804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f37c4ccf-0583-4bf3-bf76-b3b81d3f5d5d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:39.178689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f37c4ccf-0583-4bf3-bf76-b3b81d3f5d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:39.237390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:39.326799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 530/1039] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:39.642372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19760bb-3527-4639-a604-ed3f48de6771 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:39.650380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f19760bb-3527-4639-a604-ed3f48de6771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:39.906042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19760bb-3527-4639-a604-ed3f48de6771 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:39.930208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:40.130951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa664e-2a61-46e5-820c-a51238b7b015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:40.131841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa664e-2a61-46e5-820c-a51238b7b015 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:40.132526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa664e-2a61-46e5-820c-a51238b7b015 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:40.132973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa664e-2a61-46e5-820c-a51238b7b015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:40.135497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1efa664e-2a61-46e5-820c-a51238b7b015 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:40.264226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa664e-2a61-46e5-820c-a51238b7b015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:40.265898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa664e-2a61-46e5-820c-a51238b7b015 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:40.288047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 510/1040] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:42.934661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc4fb-e148-45f7-9e5f-2b89d0fc4703 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:42.935460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc4fb-e148-45f7-9e5f-2b89d0fc4703 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:42.935460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc4fb-e148-45f7-9e5f-2b89d0fc4703 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:42.936875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 531/1041] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:42.942832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d83b4-a36b-4995-a742-f6ca8e7365cb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:42.943642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d83b4-a36b-4995-a742-f6ca8e7365cb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:42.943642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d83b4-a36b-4995-a742-f6ca8e7365cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:42.960994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:43.055830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-df3d83b4-a36b-4995-a742-f6ca8e7365cb None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:43.057814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-df3d83b4-a36b-4995-a742-f6ca8e7365cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:43.252768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 511/1042] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:52:43.554031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e3cf8-07f3-45e1-806f-d97fed6cd488 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:43.554434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e3cf8-07f3-45e1-806f-d97fed6cd488 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:43.554880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e3cf8-07f3-45e1-806f-d97fed6cd488 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:43.556547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 532/1043] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 11 11:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:43.562399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90937e-b9f6-4a5f-93e0-9c6e0044d664 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:43.562751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90937e-b9f6-4a5f-93e0-9c6e0044d664 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:43.563013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90937e-b9f6-4a5f-93e0-9c6e0044d664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:43.656351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4d90937e-b9f6-4a5f-93e0-9c6e0044d664 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:43.657576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d90937e-b9f6-4a5f-93e0-9c6e0044d664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:43.696415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:43.839531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 512/1044] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 11 11:52:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:43.847828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e3cf8-07f3-45e1-806f-d97fed6cd488 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:43.849330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f60e3cf8-07f3-45e1-806f-d97fed6cd488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:44.028392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e3cf8-07f3-45e1-806f-d97fed6cd488 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:44.053114 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:44.185683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0522d82-9a54-4ce3-b12a-849e0ee68e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:44.186298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0522d82-9a54-4ce3-b12a-849e0ee68e3d service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:44.186586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0522d82-9a54-4ce3-b12a-849e0ee68e3d service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:44.186857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0522d82-9a54-4ce3-b12a-849e0ee68e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:44.188576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a0522d82-9a54-4ce3-b12a-849e0ee68e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:44.300658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0522d82-9a54-4ce3-b12a-849e0ee68e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:44.302679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0522d82-9a54-4ce3-b12a-849e0ee68e3d service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:44.325626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 533/1045] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 11:52:44.530526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76002a-ae76-43b7-b186-92e36bfb30de None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:44.531111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76002a-ae76-43b7-b186-92e36bfb30de None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:44.531111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76002a-ae76-43b7-b186-92e36bfb30de None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:44.532557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 513/1046] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:52:44.538362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b243-9c55-4a6b-8814-86e489770f4e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:44.538604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b243-9c55-4a6b-8814-86e489770f4e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:44.538840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63b243-9c55-4a6b-8814-86e489770f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:44.577517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:44.626741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0f63b243-9c55-4a6b-8814-86e489770f4e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:44.628066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0f63b243-9c55-4a6b-8814-86e489770f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:44.749358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 534/1047] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:45.045579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb9f2-c606-49d2-aa70-a36b50e503f8 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:45.045843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb9f2-c606-49d2-aa70-a36b50e503f8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:45.046030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbb9f2-c606-49d2-aa70-a36b50e503f8 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:45.047788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 514/1048] 10.222.0.48 () {54 vars in 963 bytes} [Tue Oct 11 11:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:45.053843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93560fa0-b94a-44c5-aa6b-60095e217477 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:45.054313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93560fa0-b94a-44c5-aa6b-60095e217477 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:45.054678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93560fa0-b94a-44c5-aa6b-60095e217477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:45.166866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-93560fa0-b94a-44c5-aa6b-60095e217477 None None] MFA Rules not processed for user `bb63e30c48464c1ebe9305c620291c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:45.168258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-93560fa0-b94a-44c5-aa6b-60095e217477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:45.231143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:45.282665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 535/1049] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Oct 11 11:52:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:45.292870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbb9f2-c606-49d2-aa70-a36b50e503f8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:45.297678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-15fbb9f2-c606-49d2-aa70-a36b50e503f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:45.518201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbb9f2-c606-49d2-aa70-a36b50e503f8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:45.563982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:45.609965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793402e0-f9ed-42f3-ae60-3ec155c87cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:45.610810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793402e0-f9ed-42f3-ae60-3ec155c87cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:45.611335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793402e0-f9ed-42f3-ae60-3ec155c87cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:45.611697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793402e0-f9ed-42f3-ae60-3ec155c87cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:45.613499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-793402e0-f9ed-42f3-ae60-3ec155c87cc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:45.748992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793402e0-f9ed-42f3-ae60-3ec155c87cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:45.750457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793402e0-f9ed-42f3-ae60-3ec155c87cc8 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:45.775770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 515/1050] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:46.671546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36e1b-01e4-4744-bc81-ec76b3a8e362 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:46.672073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36e1b-01e4-4744-bc81-ec76b3a8e362 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:46.672073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36e1b-01e4-4744-bc81-ec76b3a8e362 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:46.673432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 536/1051] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:46.679088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f4cf-1c46-41b9-be95-4ad3b53a6072 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:46.679565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f4cf-1c46-41b9-be95-4ad3b53a6072 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:46.679672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670f4cf-1c46-41b9-be95-4ad3b53a6072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:46.768371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2670f4cf-1c46-41b9-be95-4ad3b53a6072 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:46.770040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2670f4cf-1c46-41b9-be95-4ad3b53a6072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:46.795948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:46.880192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 516/1052] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:47.197209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36e1b-01e4-4744-bc81-ec76b3a8e362 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:47.198891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-49c36e1b-01e4-4744-bc81-ec76b3a8e362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:47.389378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36e1b-01e4-4744-bc81-ec76b3a8e362 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:47.478828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:47.572389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c686f-dc1e-4940-bb68-0ff1261a4640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:47.573398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c686f-dc1e-4940-bb68-0ff1261a4640 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:47.573850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c686f-dc1e-4940-bb68-0ff1261a4640 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:47.574179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c686f-dc1e-4940-bb68-0ff1261a4640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:47.576284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6a9c686f-dc1e-4940-bb68-0ff1261a4640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:47.694495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c686f-dc1e-4940-bb68-0ff1261a4640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:47.696686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c686f-dc1e-4940-bb68-0ff1261a4640 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:47.720096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 537/1053] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:50.351358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8721ae5-7a14-4569-9da1-9fa0887c31c4 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:50.351920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8721ae5-7a14-4569-9da1-9fa0887c31c4 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:50.352135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8721ae5-7a14-4569-9da1-9fa0887c31c4 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:50.354892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 517/1054] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:50.361071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26eeb-223b-47c5-8269-13c28e082696 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:50.362304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26eeb-223b-47c5-8269-13c28e082696 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:50.362304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26eeb-223b-47c5-8269-13c28e082696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:50.465529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-96a26eeb-223b-47c5-8269-13c28e082696 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:50.467512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-96a26eeb-223b-47c5-8269-13c28e082696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:50.480169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:50.650005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 538/1055] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:51.182708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8721ae5-7a14-4569-9da1-9fa0887c31c4 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:51.184857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d8721ae5-7a14-4569-9da1-9fa0887c31c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:51.483908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8721ae5-7a14-4569-9da1-9fa0887c31c4 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:51.491974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:51.681813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b005d-a57c-4a5f-b6bf-05c8106658b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:51.682647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b005d-a57c-4a5f-b6bf-05c8106658b4 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:51.683109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b005d-a57c-4a5f-b6bf-05c8106658b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:51.683471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b005d-a57c-4a5f-b6bf-05c8106658b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:51.685401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e32b005d-a57c-4a5f-b6bf-05c8106658b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:51.794048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b005d-a57c-4a5f-b6bf-05c8106658b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:51.795740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b005d-a57c-4a5f-b6bf-05c8106658b4 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:51.828700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 518/1056] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:54.209390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a444-c2ee-4f65-b70a-7701ee0c0cbe None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:54.210059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a444-c2ee-4f65-b70a-7701ee0c0cbe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:54.210059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28a444-c2ee-4f65-b70a-7701ee0c0cbe None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:54.211437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 539/1057] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:54.217698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a816c-01fe-4eeb-94c6-72f4fe5cbff6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:54.218196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a816c-01fe-4eeb-94c6-72f4fe5cbff6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:54.218445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a816c-01fe-4eeb-94c6-72f4fe5cbff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:54.234014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:54.333623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0c0a816c-01fe-4eeb-94c6-72f4fe5cbff6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:54.335926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0c0a816c-01fe-4eeb-94c6-72f4fe5cbff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:54.475099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 519/1058] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:54.766479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a444-c2ee-4f65-b70a-7701ee0c0cbe None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:54.768141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8a28a444-c2ee-4f65-b70a-7701ee0c0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:54.956333 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:54.969825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28a444-c2ee-4f65-b70a-7701ee0c0cbe None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:55.102189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668ad54-0e9c-4cd8-8daf-288fe4e61a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:55.102770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668ad54-0e9c-4cd8-8daf-288fe4e61a29 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:55.103046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668ad54-0e9c-4cd8-8daf-288fe4e61a29 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:55.103315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668ad54-0e9c-4cd8-8daf-288fe4e61a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:55.105055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4668ad54-0e9c-4cd8-8daf-288fe4e61a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:55.229198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668ad54-0e9c-4cd8-8daf-288fe4e61a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:55.232996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668ad54-0e9c-4cd8-8daf-288fe4e61a29 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:55.249820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:55.265389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 540/1059] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:52:57.599665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3052-8736-4317-aee9-4376b8737c25 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:57.600636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3052-8736-4317-aee9-4376b8737c25 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:57.600636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3052-8736-4317-aee9-4376b8737c25 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:57.602519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 520/1060] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:52:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:52:57.609212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae83a57-7703-4e73-be95-2cdf77cbf202 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:57.609706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae83a57-7703-4e73-be95-2cdf77cbf202 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:57.609806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae83a57-7703-4e73-be95-2cdf77cbf202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:57.684189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7ae83a57-7703-4e73-be95-2cdf77cbf202 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:52:57.685462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7ae83a57-7703-4e73-be95-2cdf77cbf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:57.798050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 541/1061] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:52:58.113319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa3052-8736-4317-aee9-4376b8737c25 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:52:58.115013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-34fa3052-8736-4317-aee9-4376b8737c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:58.220373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:58.296624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa3052-8736-4317-aee9-4376b8737c25 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:52:58.441080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6385394-988a-45f0-b44d-4da964fc378c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:52:58.441737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6385394-988a-45f0-b44d-4da964fc378c service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:52:58.442012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6385394-988a-45f0-b44d-4da964fc378c service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:52:58.442337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6385394-988a-45f0-b44d-4da964fc378c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:52:58.444060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d6385394-988a-45f0-b44d-4da964fc378c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:52:58.524324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:58.578484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6385394-988a-45f0-b44d-4da964fc378c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:52:58.580841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6385394-988a-45f0-b44d-4da964fc378c service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:52:58.605425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 521/1062] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:01.056058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5770b8-5d2c-4bf4-9a5d-72ed4d059c22 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:01.056671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5770b8-5d2c-4bf4-9a5d-72ed4d059c22 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:01.056830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5770b8-5d2c-4bf4-9a5d-72ed4d059c22 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:01.058750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 542/1063] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:53:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:01.065123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548bd9-dcb5-440a-aa05-7b2b5fc8ed7c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:01.065812 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548bd9-dcb5-440a-aa05-7b2b5fc8ed7c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:01.065812 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548bd9-dcb5-440a-aa05-7b2b5fc8ed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:01.147462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c9548bd9-dcb5-440a-aa05-7b2b5fc8ed7c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:01.148790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c9548bd9-dcb5-440a-aa05-7b2b5fc8ed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:01.266229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 522/1064] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:01.558067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5770b8-5d2c-4bf4-9a5d-72ed4d059c22 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:01.559729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3e5770b8-5d2c-4bf4-9a5d-72ed4d059c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:01.672675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:01.772024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5770b8-5d2c-4bf4-9a5d-72ed4d059c22 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:01.911529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcec106-8b6f-4a87-b1d9-7cb2035234f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:01.912432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec106-8b6f-4a87-b1d9-7cb2035234f0 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:01.912803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec106-8b6f-4a87-b1d9-7cb2035234f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:01.913163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec106-8b6f-4a87-b1d9-7cb2035234f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:01.915539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ddcec106-8b6f-4a87-b1d9-7cb2035234f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:01.971809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:02.038188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcec106-8b6f-4a87-b1d9-7cb2035234f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:02.040011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcec106-8b6f-4a87-b1d9-7cb2035234f0 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:02.059707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 543/1065] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:04.443262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59674-9ab3-435d-8faa-0a8c1c05e909 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:04.443839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59674-9ab3-435d-8faa-0a8c1c05e909 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:04.443839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59674-9ab3-435d-8faa-0a8c1c05e909 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:04.445213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 523/1066] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:04.454091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05560-274b-473a-8aa3-95001ee77464 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:04.454880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05560-274b-473a-8aa3-95001ee77464 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:04.454880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce05560-274b-473a-8aa3-95001ee77464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:04.539976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4ce05560-274b-473a-8aa3-95001ee77464 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:04.541807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4ce05560-274b-473a-8aa3-95001ee77464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:04.673395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 544/1067] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:53:04.704891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da687c4-938a-496b-b69b-eb12d75937c5 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:04.705158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da687c4-938a-496b-b69b-eb12d75937c5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:04.705647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da687c4-938a-496b-b69b-eb12d75937c5 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:04.708372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 524/1068] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:53:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:04.716257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4288fc-b029-40e2-b2a0-c3a2c2129aa8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:04.716844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4288fc-b029-40e2-b2a0-c3a2c2129aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:04.717175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4288fc-b029-40e2-b2a0-c3a2c2129aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:04.733787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:04.799400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9e4288fc-b029-40e2-b2a0-c3a2c2129aa8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:04.800705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9e4288fc-b029-40e2-b2a0-c3a2c2129aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:04.934046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 545/1069] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:04.963128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da687c4-938a-496b-b69b-eb12d75937c5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:04.964553 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7da687c4-938a-496b-b69b-eb12d75937c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:05.008094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:05.173104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da687c4-938a-496b-b69b-eb12d75937c5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:05.241615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0cfd-4e21-4af2-a64e-e9be0057a90a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:05.241929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0cfd-4e21-4af2-a64e-e9be0057a90a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:05.242143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba0cfd-4e21-4af2-a64e-e9be0057a90a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:05.243572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 546/1070] 10.222.0.48 () {54 vars in 962 bytes} [Tue Oct 11 11:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:05.249023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22816-4a6a-485d-b724-8a730da8ef70 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:05.249301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22816-4a6a-485d-b724-8a730da8ef70 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:05.249545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22816-4a6a-485d-b724-8a730da8ef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:05.313468 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:05.325790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:05.326426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:05.326745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:05.327009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:05.328671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:05.379808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-55f22816-4a6a-485d-b724-8a730da8ef70 None None] MFA Rules not processed for user `b78db6f3cf17421898e1597c65998fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:05.381480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-55f22816-4a6a-485d-b724-8a730da8ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:05.426608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:05.428241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:05.433889 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:05.448558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 525/1071] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 11:53:05.495671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 547/1072] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Oct 11 11:53:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:05.507194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:05.509484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:05.636269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecea56a-64eb-4f3e-bd57-3e25e0bf950b service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:05.688206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:05.742610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebfbfa-d785-45bc-836f-1ccefa981887 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78db6f3cf17421898e1597c65998fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:05.743662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebfbfa-d785-45bc-836f-1ccefa981887 service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:05.744016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebfbfa-d785-45bc-836f-1ccefa981887 service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:05.744528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebfbfa-d785-45bc-836f-1ccefa981887 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:05.747807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-02ebfbfa-d785-45bc-836f-1ccefa981887 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:05.922607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebfbfa-d785-45bc-836f-1ccefa981887 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:05.924232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebfbfa-d785-45bc-836f-1ccefa981887 service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:05.945641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 526/1073] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:06.831025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e0fb-21e8-4753-80ad-7703e203d303 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:06.831855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e0fb-21e8-4753-80ad-7703e203d303 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:06.832020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150e0fb-21e8-4753-80ad-7703e203d303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:06.957530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a150e0fb-21e8-4753-80ad-7703e203d303 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:06.960136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a150e0fb-21e8-4753-80ad-7703e203d303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:07.087664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 548/1074] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 11:53:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:07.148619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a578-8719-41ae-b983-59f352ddb5db None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:07.149147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a578-8719-41ae-b983-59f352ddb5db None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:07.149147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a578-8719-41ae-b983-59f352ddb5db None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:07.151325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 527/1075] 10.222.0.48 () {54 vars in 943 bytes} [Tue Oct 11 11:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:07.159785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bdf2c-6ba6-4217-9584-a86a82754c46 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:07.160167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bdf2c-6ba6-4217-9584-a86a82754c46 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:07.160504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bdf2c-6ba6-4217-9584-a86a82754c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:07.227266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:07.249616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3b6bdf2c-6ba6-4217-9584-a86a82754c46 None None] MFA Rules not processed for user `f947cc3d958a49549b74d210453f2ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:07.251012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3b6bdf2c-6ba6-4217-9584-a86a82754c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:07.391245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 549/1076] 10.222.0.48 () {58 vars in 1040 bytes} [Tue Oct 11 11:53:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:07.401101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a578-8719-41ae-b983-59f352ddb5db None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:07.402687 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-47c1a578-8719-41ae-b983-59f352ddb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:07.497634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:07.570602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a578-8719-41ae-b983-59f352ddb5db None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:07.704251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:07.704927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:07.705204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:07.705467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:07.707204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:07.765319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c433-fca2-4c7e-b312-47a0c7be3a69 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:07.765572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c433-fca2-4c7e-b312-47a0c7be3a69 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:07.765729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c433-fca2-4c7e-b312-47a0c7be3a69 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:07.767234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 550/1077] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 11:53:07.771995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:07.773180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40557-392c-4f70-990a-b966c5850a93 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:07.773475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40557-392c-4f70-990a-b966c5850a93 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:07.773733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40557-392c-4f70-990a-b966c5850a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:07.803741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:07.805682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:07.817331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 528/1078] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 11:53:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 11:53:07.854755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-67e40557-392c-4f70-990a-b966c5850a93 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:07.855912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-67e40557-392c-4f70-990a-b966c5850a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:07.950599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:08.022223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 551/1079] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:53:08.320822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:08.322044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:08.467909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f998e-d666-4c66-bcf0-ed40732d4dfa service swift] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:08.608713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:08.623198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83508d31-4e98-474f-9c5b-ba1d1fd22570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:08.624332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508d31-4e98-474f-9c5b-ba1d1fd22570 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:08.624773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508d31-4e98-474f-9c5b-ba1d1fd22570 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:08.625194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83508d31-4e98-474f-9c5b-ba1d1fd22570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:08.628206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-83508d31-4e98-474f-9c5b-ba1d1fd22570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:08.769548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508d31-4e98-474f-9c5b-ba1d1fd22570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:08.771198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83508d31-4e98-474f-9c5b-ba1d1fd22570 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:08.797728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 529/1080] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:11.259453 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a4ef-251a-448b-87f0-caadd51a70e6 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:11.260289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a4ef-251a-448b-87f0-caadd51a70e6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:11.260289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a4ef-251a-448b-87f0-caadd51a70e6 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:11.261257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 552/1081] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:11.268365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271f76-b440-470f-b91e-ae283c49b85d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:11.269915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271f76-b440-470f-b91e-ae283c49b85d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:11.270763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271f76-b440-470f-b91e-ae283c49b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:11.368183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f6271f76-b440-470f-b91e-ae283c49b85d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:11.369867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f6271f76-b440-470f-b91e-ae283c49b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:11.444318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:11.514680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 530/1082] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:11.824108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076a4ef-251a-448b-87f0-caadd51a70e6 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:11.826043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4076a4ef-251a-448b-87f0-caadd51a70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:12.051229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076a4ef-251a-448b-87f0-caadd51a70e6 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:12.135655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:12.244892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439645a1-d12b-4e62-b9e4-136f0ce974cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:12.245537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439645a1-d12b-4e62-b9e4-136f0ce974cc service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:12.245807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439645a1-d12b-4e62-b9e4-136f0ce974cc service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:12.246066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439645a1-d12b-4e62-b9e4-136f0ce974cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:12.247730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-439645a1-d12b-4e62-b9e4-136f0ce974cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:12.402491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439645a1-d12b-4e62-b9e4-136f0ce974cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:12.405423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439645a1-d12b-4e62-b9e4-136f0ce974cc service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:12.438179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 553/1083] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:14.884632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81273fc-e4b0-4447-b15e-c233f9e321f2 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:14.885155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81273fc-e4b0-4447-b15e-c233f9e321f2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:14.885155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81273fc-e4b0-4447-b15e-c233f9e321f2 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:14.886622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 531/1084] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:14.892525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f77c-e0d8-4661-8f72-7c59261fd02d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:14.893355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f77c-e0d8-4661-8f72-7c59261fd02d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:14.893355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f77c-e0d8-4661-8f72-7c59261fd02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:14.964366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:14.973493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cd94f77c-e0d8-4661-8f72-7c59261fd02d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:14.975057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cd94f77c-e0d8-4661-8f72-7c59261fd02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:15.107023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 554/1085] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:15.404052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81273fc-e4b0-4447-b15e-c233f9e321f2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:15.406048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c81273fc-e4b0-4447-b15e-c233f9e321f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:15.643481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81273fc-e4b0-4447-b15e-c233f9e321f2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:15.743021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:15.845926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be9feb-2861-4786-b91c-79d9b6eba893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:15.846932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be9feb-2861-4786-b91c-79d9b6eba893 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:15.846932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be9feb-2861-4786-b91c-79d9b6eba893 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:15.847248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be9feb-2861-4786-b91c-79d9b6eba893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:15.848958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-73be9feb-2861-4786-b91c-79d9b6eba893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:16.003450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be9feb-2861-4786-b91c-79d9b6eba893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:16.006102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be9feb-2861-4786-b91c-79d9b6eba893 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:16.030591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 532/1086] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:25.101345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=44 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:26.028144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=77 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:30.727618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d661-c906-4334-a4bb-033d79d149c1 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:30.728168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d661-c906-4334-a4bb-033d79d149c1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:30.728168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d661-c906-4334-a4bb-033d79d149c1 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:30.729500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 555/1087] 10.222.0.48 () {54 vars in 918 bytes} [Tue Oct 11 11:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:30.735869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a3b5a-ab42-4d18-a0e7-990fad1c95e1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:30.736424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a3b5a-ab42-4d18-a0e7-990fad1c95e1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:30.736424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a3b5a-ab42-4d18-a0e7-990fad1c95e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:30.826194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5f4a3b5a-ab42-4d18-a0e7-990fad1c95e1 None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:30.827486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5f4a3b5a-ab42-4d18-a0e7-990fad1c95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:30.945415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 533/1088] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Oct 11 11:53:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:53:30.960609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1d93-ffeb-42da-abbf-5fee6959e7a0 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:30.960887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1d93-ffeb-42da-abbf-5fee6959e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:30.961153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd1d93-ffeb-42da-abbf-5fee6959e7a0 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:30.962513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 556/1089] 10.222.0.48 () {54 vars in 918 bytes} [Tue Oct 11 11:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:30.967545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944bb9-d593-46ff-8fc1-00578cec4720 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:30.967828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944bb9-d593-46ff-8fc1-00578cec4720 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:30.968095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9944bb9-d593-46ff-8fc1-00578cec4720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:31.043387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:31.047028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d9944bb9-d593-46ff-8fc1-00578cec4720 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:31.048905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d9944bb9-d593-46ff-8fc1-00578cec4720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:31.173841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 534/1090] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Oct 11 11:53:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:33.816247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3845e4-a46a-4f96-a054-a1dd9c3e58ea None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:33.817084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3845e4-a46a-4f96-a054-a1dd9c3e58ea None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:33.817084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3845e4-a46a-4f96-a054-a1dd9c3e58ea None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:33.818460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 557/1091] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:33.825227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c6c2-551c-4b93-9a2b-209c7ede0d15 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:33.825756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c6c2-551c-4b93-9a2b-209c7ede0d15 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:33.825756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5c6c2-551c-4b93-9a2b-209c7ede0d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:33.899423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c8a5c6c2-551c-4b93-9a2b-209c7ede0d15 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:33.900631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c8a5c6c2-551c-4b93-9a2b-209c7ede0d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:33.961621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:34.016373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 535/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:34.309396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3845e4-a46a-4f96-a054-a1dd9c3e58ea None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:34.311155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-da3845e4-a46a-4f96-a054-a1dd9c3e58ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:34.471390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3845e4-a46a-4f96-a054-a1dd9c3e58ea None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:34.559838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:34.608937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fa46f-fe4e-4729-b805-fbd807f723eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:34.609757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fa46f-fe4e-4729-b805-fbd807f723eb service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:34.610223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fa46f-fe4e-4729-b805-fbd807f723eb service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:34.610499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fa46f-fe4e-4729-b805-fbd807f723eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:34.612162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-798fa46f-fe4e-4729-b805-fbd807f723eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:34.707754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fa46f-fe4e-4729-b805-fbd807f723eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:34.709249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fa46f-fe4e-4729-b805-fbd807f723eb service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:34.727930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 558/1093] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:35.870935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971605de-6200-4d6e-b0ca-5d349848d034 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:35.871519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971605de-6200-4d6e-b0ca-5d349848d034 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:35.871519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971605de-6200-4d6e-b0ca-5d349848d034 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:35.872874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 536/1094] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:35.879972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58c515-6670-454d-b2be-3c65c74824d6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:35.880518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58c515-6670-454d-b2be-3c65c74824d6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:35.880518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58c515-6670-454d-b2be-3c65c74824d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:35.963065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2a58c515-6670-454d-b2be-3c65c74824d6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:35.964268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2a58c515-6670-454d-b2be-3c65c74824d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:36.004719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:36.079102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 559/1095] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:36.230495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971605de-6200-4d6e-b0ca-5d349848d034 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:36.232102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-971605de-6200-4d6e-b0ca-5d349848d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:36.405635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971605de-6200-4d6e-b0ca-5d349848d034 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:36.454370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:36.541319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d679a6b-f14b-4e4a-aa80-4ecbf4b2a2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:36.541935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679a6b-f14b-4e4a-aa80-4ecbf4b2a2f5 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:36.542205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679a6b-f14b-4e4a-aa80-4ecbf4b2a2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:36.542471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d679a6b-f14b-4e4a-aa80-4ecbf4b2a2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:36.544118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8d679a6b-f14b-4e4a-aa80-4ecbf4b2a2f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:36.638301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679a6b-f14b-4e4a-aa80-4ecbf4b2a2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:36.639943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d679a6b-f14b-4e4a-aa80-4ecbf4b2a2f5 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:36.658354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 537/1096] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:37.815496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cafe1e-666b-4502-9a41-337969f88fc3 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:37.816134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cafe1e-666b-4502-9a41-337969f88fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:37.816134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cafe1e-666b-4502-9a41-337969f88fc3 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:37.817482 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 560/1097] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:37.824761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809489dd-2857-4057-83ca-23f6352e0523 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:37.825314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809489dd-2857-4057-83ca-23f6352e0523 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:37.825314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809489dd-2857-4057-83ca-23f6352e0523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:37.887296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:37.913173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-809489dd-2857-4057-83ca-23f6352e0523 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:37.914429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-809489dd-2857-4057-83ca-23f6352e0523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:38.024081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 538/1098] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:38.178704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cafe1e-666b-4502-9a41-337969f88fc3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:38.180265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-98cafe1e-666b-4502-9a41-337969f88fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:38.347156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cafe1e-666b-4502-9a41-337969f88fc3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:38.360240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:38.470402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4f9c3-9b6b-4a81-bab5-f50d4ef6be2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:38.471082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4f9c3-9b6b-4a81-bab5-f50d4ef6be2d service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:38.471377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4f9c3-9b6b-4a81-bab5-f50d4ef6be2d service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:38.471637 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4f9c3-9b6b-4a81-bab5-f50d4ef6be2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:38.473262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e9f4f9c3-9b6b-4a81-bab5-f50d4ef6be2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:38.568169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4f9c3-9b6b-4a81-bab5-f50d4ef6be2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:38.569797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4f9c3-9b6b-4a81-bab5-f50d4ef6be2d service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:38.588236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 561/1099] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:39.705966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccec3bc-3cca-46d9-a056-e78ac4d5d66e None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:39.706595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccec3bc-3cca-46d9-a056-e78ac4d5d66e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:39.706595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccec3bc-3cca-46d9-a056-e78ac4d5d66e None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:39.707863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 539/1100] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:39.714650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3336-0792-457c-ad69-5afceccb8b05 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:39.715225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3336-0792-457c-ad69-5afceccb8b05 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:39.715225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f3336-0792-457c-ad69-5afceccb8b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:39.736672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:39.797977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5f8f3336-0792-457c-ad69-5afceccb8b05 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:39.799232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5f8f3336-0792-457c-ad69-5afceccb8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:39.901562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 562/1101] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:40.055682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccec3bc-3cca-46d9-a056-e78ac4d5d66e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:40.057232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9ccec3bc-3cca-46d9-a056-e78ac4d5d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:40.185869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:40.224620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccec3bc-3cca-46d9-a056-e78ac4d5d66e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:40.344551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db380b29-753b-468e-84b8-cb4c36cd623f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:40.345062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380b29-753b-468e-84b8-cb4c36cd623f service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:40.345331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380b29-753b-468e-84b8-cb4c36cd623f service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:40.345584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380b29-753b-468e-84b8-cb4c36cd623f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:40.347186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-db380b29-753b-468e-84b8-cb4c36cd623f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:40.428320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:40.443971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db380b29-753b-468e-84b8-cb4c36cd623f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:40.445647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db380b29-753b-468e-84b8-cb4c36cd623f service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:40.465214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 540/1102] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:41.601883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816c828-b89e-4833-a6df-cd10b61ba1c9 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:41.602452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816c828-b89e-4833-a6df-cd10b61ba1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:41.602452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816c828-b89e-4833-a6df-cd10b61ba1c9 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:41.603845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 563/1103] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:41.610849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e48e-ae21-4377-aa65-12d59d12ae5e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:41.611364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e48e-ae21-4377-aa65-12d59d12ae5e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:41.611364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e48e-ae21-4377-aa65-12d59d12ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:41.695277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5938e48e-ae21-4377-aa65-12d59d12ae5e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:41.696492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5938e48e-ae21-4377-aa65-12d59d12ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:41.804490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 541/1104] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:41.961354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816c828-b89e-4833-a6df-cd10b61ba1c9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:41.962924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f816c828-b89e-4833-a6df-cd10b61ba1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:42.061654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:42.128703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816c828-b89e-4833-a6df-cd10b61ba1c9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:42.248361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de84ac5-7c15-48a1-b63a-13e23251fdef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:42.248876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84ac5-7c15-48a1-b63a-13e23251fdef service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:42.249147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84ac5-7c15-48a1-b63a-13e23251fdef service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:42.249418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de84ac5-7c15-48a1-b63a-13e23251fdef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:42.251082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2de84ac5-7c15-48a1-b63a-13e23251fdef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:42.304754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:42.351339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84ac5-7c15-48a1-b63a-13e23251fdef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:42.352939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de84ac5-7c15-48a1-b63a-13e23251fdef service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:42.372092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 564/1105] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:43.438895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecae55-9f6d-4f8c-8ddd-c45bffd9f32a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:43.439501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecae55-9f6d-4f8c-8ddd-c45bffd9f32a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:43.439501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecae55-9f6d-4f8c-8ddd-c45bffd9f32a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:43.440788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 542/1106] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:43.447712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacde5b-078e-4510-998e-3e5065f8bc26 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:43.448372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacde5b-078e-4510-998e-3e5065f8bc26 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:43.448372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacde5b-078e-4510-998e-3e5065f8bc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:43.534172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1bacde5b-078e-4510-998e-3e5065f8bc26 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:43.535493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1bacde5b-078e-4510-998e-3e5065f8bc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:43.677778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 565/1107] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:43.835384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecae55-9f6d-4f8c-8ddd-c45bffd9f32a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:43.836844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-35ecae55-9f6d-4f8c-8ddd-c45bffd9f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:43.888594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:43.990053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecae55-9f6d-4f8c-8ddd-c45bffd9f32a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:44.111237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3e272-9bc7-4b5f-a080-1bef97b00b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:44.111781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e272-9bc7-4b5f-a080-1bef97b00b7f service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:44.112028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e272-9bc7-4b5f-a080-1bef97b00b7f service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:44.112316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e272-9bc7-4b5f-a080-1bef97b00b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:44.113940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ffd3e272-9bc7-4b5f-a080-1bef97b00b7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:44.121436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:44.208323 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e272-9bc7-4b5f-a080-1bef97b00b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:44.209968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e272-9bc7-4b5f-a080-1bef97b00b7f service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:44.229046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 543/1108] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:45.314902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41529-0bf7-4936-ac59-c6684de7c23f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:45.315551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41529-0bf7-4936-ac59-c6684de7c23f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:45.315551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41529-0bf7-4936-ac59-c6684de7c23f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:45.316688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 566/1109] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:45.323619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2744-4d20-4503-a3aa-4790a9b8c98a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:45.324447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2744-4d20-4503-a3aa-4790a9b8c98a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:45.324447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e2744-4d20-4503-a3aa-4790a9b8c98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:45.405995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b41e2744-4d20-4503-a3aa-4790a9b8c98a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:45.407278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b41e2744-4d20-4503-a3aa-4790a9b8c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:45.483448 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:45.515537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 544/1110] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:53:45.668962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41529-0bf7-4936-ac59-c6684de7c23f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:45.671600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f1f41529-0bf7-4936-ac59-c6684de7c23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:45.696334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:45.835306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41529-0bf7-4936-ac59-c6684de7c23f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:45.925062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:45.951704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5b3e8-cf22-45fc-a764-886ad4382422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:45.952308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b3e8-cf22-45fc-a764-886ad4382422 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:45.952575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b3e8-cf22-45fc-a764-886ad4382422 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:45.952834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5b3e8-cf22-45fc-a764-886ad4382422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:45.954506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0da5b3e8-cf22-45fc-a764-886ad4382422 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:46.048063 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5b3e8-cf22-45fc-a764-886ad4382422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:46.049650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5b3e8-cf22-45fc-a764-886ad4382422 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:46.067825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 567/1111] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:47.175528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d842ca4-ba14-4177-97b1-47910873cf67 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:47.176155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d842ca4-ba14-4177-97b1-47910873cf67 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:47.176155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d842ca4-ba14-4177-97b1-47910873cf67 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:47.177488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 545/1112] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:47.184823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faac78-d18e-43ae-9ac1-1954e496997d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:47.185415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faac78-d18e-43ae-9ac1-1954e496997d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:47.185415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faac78-d18e-43ae-9ac1-1954e496997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:47.273484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-12faac78-d18e-43ae-9ac1-1954e496997d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:47.274663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-12faac78-d18e-43ae-9ac1-1954e496997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:47.322173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:47.383453 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 568/1113] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:47.536359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d842ca4-ba14-4177-97b1-47910873cf67 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:47.537828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9d842ca4-ba14-4177-97b1-47910873cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:47.691987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d842ca4-ba14-4177-97b1-47910873cf67 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:47.751906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:47.816370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71391d05-d5b1-43b5-84aa-2f4ff789d908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:47.816900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391d05-d5b1-43b5-84aa-2f4ff789d908 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:47.817183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391d05-d5b1-43b5-84aa-2f4ff789d908 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:47.817446 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71391d05-d5b1-43b5-84aa-2f4ff789d908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:47.819122 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-71391d05-d5b1-43b5-84aa-2f4ff789d908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:47.920778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391d05-d5b1-43b5-84aa-2f4ff789d908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:47.922449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71391d05-d5b1-43b5-84aa-2f4ff789d908 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:47.941072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 546/1114] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:49.006862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf728c5-129a-443a-af22-188484e1a7a2 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:49.007459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf728c5-129a-443a-af22-188484e1a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:49.007459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf728c5-129a-443a-af22-188484e1a7a2 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:49.008797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 569/1115] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:49.015704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41915-b240-4046-9985-cd9626646eb0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:49.016145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41915-b240-4046-9985-cd9626646eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:49.016347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41915-b240-4046-9985-cd9626646eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:49.097972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-10b41915-b240-4046-9985-cd9626646eb0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:49.099420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-10b41915-b240-4046-9985-cd9626646eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:49.101780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:49.208471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 547/1116] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:49.358506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf728c5-129a-443a-af22-188484e1a7a2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:49.359978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7cf728c5-129a-443a-af22-188484e1a7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:49.513771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf728c5-129a-443a-af22-188484e1a7a2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:49.543401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:49.635467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670aa29-771e-4425-a2c9-ae7f5c3b6652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:49.635985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670aa29-771e-4425-a2c9-ae7f5c3b6652 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:49.636258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670aa29-771e-4425-a2c9-ae7f5c3b6652 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:49.636517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670aa29-771e-4425-a2c9-ae7f5c3b6652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:49.638175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6670aa29-771e-4425-a2c9-ae7f5c3b6652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:49.730710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670aa29-771e-4425-a2c9-ae7f5c3b6652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:49.732332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670aa29-771e-4425-a2c9-ae7f5c3b6652 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:49.751361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 570/1117] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:51.829484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c00a-462f-4b55-86ff-f0a0fd3deb4f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:51.830172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c00a-462f-4b55-86ff-f0a0fd3deb4f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:51.830172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164c00a-462f-4b55-86ff-f0a0fd3deb4f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:51.831446 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 548/1118] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:51.837071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794abe-9dbf-4d69-ab11-5023c68e1098 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:51.837551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794abe-9dbf-4d69-ab11-5023c68e1098 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:51.837692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794abe-9dbf-4d69-ab11-5023c68e1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:51.884657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:51.921360 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fb794abe-9dbf-4d69-ab11-5023c68e1098 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:51.922978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fb794abe-9dbf-4d69-ab11-5023c68e1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:52.046824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 571/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:52.335522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164c00a-462f-4b55-86ff-f0a0fd3deb4f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:52.337162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6164c00a-462f-4b55-86ff-f0a0fd3deb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:52.453003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164c00a-462f-4b55-86ff-f0a0fd3deb4f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:52.486975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:52.533045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5b36a-e7be-4eb8-bbdf-62b0cdcf7681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:52.533658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b36a-e7be-4eb8-bbdf-62b0cdcf7681 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:52.533933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b36a-e7be-4eb8-bbdf-62b0cdcf7681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:52.534221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5b36a-e7be-4eb8-bbdf-62b0cdcf7681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:52.535936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5f5b36a-e7be-4eb8-bbdf-62b0cdcf7681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:52.654041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5b36a-e7be-4eb8-bbdf-62b0cdcf7681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:52.655459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5b36a-e7be-4eb8-bbdf-62b0cdcf7681 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:52.675444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 549/1120] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:54.998845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ae22b-0819-4b0f-81b7-832ce8a1ede5 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:54.999361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ae22b-0819-4b0f-81b7-832ce8a1ede5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:54.999361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ae22b-0819-4b0f-81b7-832ce8a1ede5 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:55.000889 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 572/1121] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:55.007173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae02f23-0182-4f4a-baab-4468b82c02e7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:55.007665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae02f23-0182-4f4a-baab-4468b82c02e7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:55.007867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae02f23-0182-4f4a-baab-4468b82c02e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:55.086771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-aae02f23-0182-4f4a-baab-4468b82c02e7 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:55.088023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-aae02f23-0182-4f4a-baab-4468b82c02e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:55.103751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:55.206937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 550/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:55.486885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ae22b-0819-4b0f-81b7-832ce8a1ede5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:55.488507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-371ae22b-0819-4b0f-81b7-832ce8a1ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:55.606383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ae22b-0819-4b0f-81b7-832ce8a1ede5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:55.620422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:55.686493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2590a2-5f36-4859-8611-d7247f83da2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:55.687132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2590a2-5f36-4859-8611-d7247f83da2a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:55.687401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2590a2-5f36-4859-8611-d7247f83da2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:55.687722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2590a2-5f36-4859-8611-d7247f83da2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:55.689326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dc2590a2-5f36-4859-8611-d7247f83da2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:55.816442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2590a2-5f36-4859-8611-d7247f83da2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:55.817875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2590a2-5f36-4859-8611-d7247f83da2a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:55.836582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 573/1123] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:58.361859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d782da0-b9a3-4e19-b402-aaeae6518476 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:58.362398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d782da0-b9a3-4e19-b402-aaeae6518476 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:58.362398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d782da0-b9a3-4e19-b402-aaeae6518476 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:58.363904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 551/1124] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:53:58.369488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91b20-56c6-4066-b91b-7d6dd846084b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:58.369952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91b20-56c6-4066-b91b-7d6dd846084b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:58.370067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91b20-56c6-4066-b91b-7d6dd846084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:58.422430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:58.441805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a9b91b20-56c6-4066-b91b-7d6dd846084b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:53:58.443077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a9b91b20-56c6-4066-b91b-7d6dd846084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:58.555302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 574/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:53:58.839838 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d782da0-b9a3-4e19-b402-aaeae6518476 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:53:58.841476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3d782da0-b9a3-4e19-b402-aaeae6518476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:58.953970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d782da0-b9a3-4e19-b402-aaeae6518476 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:53:59.002937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:59.043074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fb8cc-ea52-4751-a3ba-f982c08933df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:53:59.043782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb8cc-ea52-4751-a3ba-f982c08933df service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:53:59.044018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb8cc-ea52-4751-a3ba-f982c08933df service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:53:59.044328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fb8cc-ea52-4751-a3ba-f982c08933df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:53:59.045985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-903fb8cc-ea52-4751-a3ba-f982c08933df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:53:59.162699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fb8cc-ea52-4751-a3ba-f982c08933df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:53:59.164149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fb8cc-ea52-4751-a3ba-f982c08933df service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:53:59.183348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 552/1126] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:01.447017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c79f-2f47-405a-9b47-575679976c56 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:01.447559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c79f-2f47-405a-9b47-575679976c56 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:01.447559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97c79f-2f47-405a-9b47-575679976c56 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:01.448891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 575/1127] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:01.454707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726738-787c-4141-96a2-a4d71c19b678 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:01.455516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726738-787c-4141-96a2-a4d71c19b678 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:01.455676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18726738-787c-4141-96a2-a4d71c19b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:01.524601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-18726738-787c-4141-96a2-a4d71c19b678 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:01.525839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-18726738-787c-4141-96a2-a4d71c19b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:01.547201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:01.626766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 553/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:01.903370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97c79f-2f47-405a-9b47-575679976c56 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:01.904951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5b97c79f-2f47-405a-9b47-575679976c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:02.019523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97c79f-2f47-405a-9b47-575679976c56 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:02.039452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:02.094886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c6612-606a-4ed8-b7ab-12d97bf403b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:02.095505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c6612-606a-4ed8-b7ab-12d97bf403b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:02.095781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c6612-606a-4ed8-b7ab-12d97bf403b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:02.096044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c6612-606a-4ed8-b7ab-12d97bf403b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:02.097651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e38c6612-606a-4ed8-b7ab-12d97bf403b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:02.210359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c6612-606a-4ed8-b7ab-12d97bf403b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:02.211839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c6612-606a-4ed8-b7ab-12d97bf403b8 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:02.231047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 576/1129] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:04.592864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59ac1-d4eb-4f70-b63d-0bd3b13efe0a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:04.593565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59ac1-d4eb-4f70-b63d-0bd3b13efe0a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:04.593565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59ac1-d4eb-4f70-b63d-0bd3b13efe0a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:04.594859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 554/1130] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:04.600823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e80f50-04e8-4278-8701-2f332cf19b28 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:04.601296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e80f50-04e8-4278-8701-2f332cf19b28 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:04.601411 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e80f50-04e8-4278-8701-2f332cf19b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:04.668725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:04.671856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a2e80f50-04e8-4278-8701-2f332cf19b28 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:04.673569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a2e80f50-04e8-4278-8701-2f332cf19b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:04.781435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 577/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:05.061773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59ac1-d4eb-4f70-b63d-0bd3b13efe0a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:05.063437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bba59ac1-d4eb-4f70-b63d-0bd3b13efe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:05.179498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59ac1-d4eb-4f70-b63d-0bd3b13efe0a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:05.232720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:05.259957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5225a9-f721-4925-a118-03489fcc6e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:05.260574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5225a9-f721-4925-a118-03489fcc6e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:05.260940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5225a9-f721-4925-a118-03489fcc6e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:05.261095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5225a9-f721-4925-a118-03489fcc6e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:05.262780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8a5225a9-f721-4925-a118-03489fcc6e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:05.376416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5225a9-f721-4925-a118-03489fcc6e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:05.377771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5225a9-f721-4925-a118-03489fcc6e14 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:05.396452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 555/1132] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:07.654727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9eacc-873a-4963-9e0c-4c3be8f38dd0 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:07.655324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9eacc-873a-4963-9e0c-4c3be8f38dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:07.655324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9eacc-873a-4963-9e0c-4c3be8f38dd0 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:07.656640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 578/1133] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:07.662820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1abfe-74c9-43b9-b893-e07c37b8153f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:07.663400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1abfe-74c9-43b9-b893-e07c37b8153f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:07.663400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1abfe-74c9-43b9-b893-e07c37b8153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:07.735650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-01a1abfe-74c9-43b9-b893-e07c37b8153f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:07.736892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-01a1abfe-74c9-43b9-b893-e07c37b8153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:07.767337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:07.838114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 556/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:08.125402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9eacc-873a-4963-9e0c-4c3be8f38dd0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:08.127017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9db9eacc-873a-4963-9e0c-4c3be8f38dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:08.237440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9eacc-873a-4963-9e0c-4c3be8f38dd0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:08.267732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:08.315956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c8388-8b2b-4075-9505-f7255a891a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:08.316650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8388-8b2b-4075-9505-f7255a891a99 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:08.316855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8388-8b2b-4075-9505-f7255a891a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:08.317169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8388-8b2b-4075-9505-f7255a891a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:08.318824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c79c8388-8b2b-4075-9505-f7255a891a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:08.432387 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c8388-8b2b-4075-9505-f7255a891a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:08.433832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c8388-8b2b-4075-9505-f7255a891a99 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:08.453271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 579/1135] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:10.680893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee717b4-12b9-42ff-abe3-1f21b9c7887a None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:10.681470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee717b4-12b9-42ff-abe3-1f21b9c7887a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:10.681470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee717b4-12b9-42ff-abe3-1f21b9c7887a None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:10.682851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 557/1136] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:10.688996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d41ca-371b-4fe0-968a-2cb0a9173c69 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:10.689520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d41ca-371b-4fe0-968a-2cb0a9173c69 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:10.689520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d41ca-371b-4fe0-968a-2cb0a9173c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:10.758859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-460d41ca-371b-4fe0-968a-2cb0a9173c69 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:10.759973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-460d41ca-371b-4fe0-968a-2cb0a9173c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:10.768761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:10.860573 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 580/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:11.138966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee717b4-12b9-42ff-abe3-1f21b9c7887a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:11.140556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5ee717b4-12b9-42ff-abe3-1f21b9c7887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:11.254786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee717b4-12b9-42ff-abe3-1f21b9c7887a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:11.317404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:11.338335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc79a6-a69a-4607-8f4d-cb2cc807f970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:11.338977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc79a6-a69a-4607-8f4d-cb2cc807f970 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:11.339245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc79a6-a69a-4607-8f4d-cb2cc807f970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:11.339507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc79a6-a69a-4607-8f4d-cb2cc807f970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:11.341120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1ddc79a6-a69a-4607-8f4d-cb2cc807f970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:11.455531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc79a6-a69a-4607-8f4d-cb2cc807f970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:11.456979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc79a6-a69a-4607-8f4d-cb2cc807f970 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:11.475626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 558/1138] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:13.697904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e787e-fb6a-445e-bff6-3bce173e6686 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:13.698531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e787e-fb6a-445e-bff6-3bce173e6686 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:13.698531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e787e-fb6a-445e-bff6-3bce173e6686 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:13.699896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 581/1139] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:13.706302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337556c5-485b-4229-9de4-286c7bc566dc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:13.706845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337556c5-485b-4229-9de4-286c7bc566dc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:13.706845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337556c5-485b-4229-9de4-286c7bc566dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:13.776835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-337556c5-485b-4229-9de4-286c7bc566dc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:13.778067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-337556c5-485b-4229-9de4-286c7bc566dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:13.824214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:13.889770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 559/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:14.174179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e787e-fb6a-445e-bff6-3bce173e6686 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:14.175858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8a3e787e-fb6a-445e-bff6-3bce173e6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:14.285553 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e787e-fb6a-445e-bff6-3bce173e6686 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:14.326840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:14.366272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814520b-f8bc-4859-94a6-21588e298957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:14.366925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814520b-f8bc-4859-94a6-21588e298957 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:14.367202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814520b-f8bc-4859-94a6-21588e298957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:14.367471 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814520b-f8bc-4859-94a6-21588e298957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:14.369133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3814520b-f8bc-4859-94a6-21588e298957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:14.488177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814520b-f8bc-4859-94a6-21588e298957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:14.489607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814520b-f8bc-4859-94a6-21588e298957 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:14.508731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 582/1141] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:16.667217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0db6-004b-48c0-9e28-6cd87c3d7b17 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:16.667789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0db6-004b-48c0-9e28-6cd87c3d7b17 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:16.667789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce0db6-004b-48c0-9e28-6cd87c3d7b17 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:16.669145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 560/1142] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:16.675092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f115f2-bcf4-4b76-b8e5-e786e611af10 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:16.675618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f115f2-bcf4-4b76-b8e5-e786e611af10 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:16.675618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f115f2-bcf4-4b76-b8e5-e786e611af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:16.749935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a7f115f2-bcf4-4b76-b8e5-e786e611af10 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:16.751102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a7f115f2-bcf4-4b76-b8e5-e786e611af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:16.770537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:16.859613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 583/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:17.137523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce0db6-004b-48c0-9e28-6cd87c3d7b17 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:17.139114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5fce0db6-004b-48c0-9e28-6cd87c3d7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:17.249754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce0db6-004b-48c0-9e28-6cd87c3d7b17 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:17.322092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:17.329952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c83d25-e4c1-41c5-9358-c82c16c04024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:17.330583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c83d25-e4c1-41c5-9358-c82c16c04024 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:17.330899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c83d25-e4c1-41c5-9358-c82c16c04024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:17.331139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c83d25-e4c1-41c5-9358-c82c16c04024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:17.332809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-73c83d25-e4c1-41c5-9358-c82c16c04024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:17.452231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c83d25-e4c1-41c5-9358-c82c16c04024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:17.453718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c83d25-e4c1-41c5-9358-c82c16c04024 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:17.472590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 561/1144] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:19.670934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502b920-c8b6-448f-9f8b-99a63f04c73c None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:19.671611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502b920-c8b6-448f-9f8b-99a63f04c73c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:19.671611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502b920-c8b6-448f-9f8b-99a63f04c73c None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:19.672875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 584/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:19.678714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb430d-b58a-45b0-87e6-8747b5d04e7d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:19.679332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb430d-b58a-45b0-87e6-8747b5d04e7d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:19.679332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb430d-b58a-45b0-87e6-8747b5d04e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:19.758287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-39eb430d-b58a-45b0-87e6-8747b5d04e7d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:19.759556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-39eb430d-b58a-45b0-87e6-8747b5d04e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:19.814512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:19.868879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 562/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:20.148659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502b920-c8b6-448f-9f8b-99a63f04c73c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:20.150195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c502b920-c8b6-448f-9f8b-99a63f04c73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:20.262011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502b920-c8b6-448f-9f8b-99a63f04c73c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:20.312847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:20.339103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca3f90-99a4-43a0-8f49-8135d71ffba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:20.339698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca3f90-99a4-43a0-8f49-8135d71ffba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:20.339970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca3f90-99a4-43a0-8f49-8135d71ffba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:20.340233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca3f90-99a4-43a0-8f49-8135d71ffba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:20.341836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ceca3f90-99a4-43a0-8f49-8135d71ffba6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:20.454187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca3f90-99a4-43a0-8f49-8135d71ffba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:20.455684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca3f90-99a4-43a0-8f49-8135d71ffba6 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:20.475542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 585/1147] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:29.867196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=22 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:30.472973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=66 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:40.480729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4e4c-5197-46a1-8713-6f07acf03aca None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:40.481196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4e4c-5197-46a1-8713-6f07acf03aca None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:40.481399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4e4c-5197-46a1-8713-6f07acf03aca None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:40.482657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 563/1148] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:40.488555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c824-dc14-4bb1-a574-d2b21863c820 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:40.489068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c824-dc14-4bb1-a574-d2b21863c820 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:40.489068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793c824-dc14-4bb1-a574-d2b21863c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:40.560952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9793c824-dc14-4bb1-a574-d2b21863c820 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:40.562783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9793c824-dc14-4bb1-a574-d2b21863c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:40.677244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 586/1149] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:54:40.981399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2998396-c5ac-46e2-8918-27bfb1601045 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:40.981676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2998396-c5ac-46e2-8918-27bfb1601045 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:40.981943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2998396-c5ac-46e2-8918-27bfb1601045 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:40.983384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 564/1150] 10.222.0.48 () {54 vars in 962 bytes} [Tue Oct 11 11:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:40.988926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74204-4202-4a5a-b82a-5934c86a3075 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:40.989202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74204-4202-4a5a-b82a-5934c86a3075 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:40.989489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e74204-4202-4a5a-b82a-5934c86a3075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:41.069495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f4e74204-4202-4a5a-b82a-5934c86a3075 None None] MFA Rules not processed for user `b78db6f3cf17421898e1597c65998fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:41.070742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f4e74204-4202-4a5a-b82a-5934c86a3075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:41.092698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:41.150683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 587/1151] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Oct 11 11:54:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:41.158726 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2998396-c5ac-46e2-8918-27bfb1601045 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:41.160286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a2998396-c5ac-46e2-8918-27bfb1601045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:41.269831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2998396-c5ac-46e2-8918-27bfb1601045 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:41.356667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b4b9e-f647-42b3-aaab-6d25e7925ab9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78db6f3cf17421898e1597c65998fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:41.357288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b4b9e-f647-42b3-aaab-6d25e7925ab9 service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:41.357564 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b4b9e-f647-42b3-aaab-6d25e7925ab9 service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:41.357818 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b4b9e-f647-42b3-aaab-6d25e7925ab9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:41.359629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dc7b4b9e-f647-42b3-aaab-6d25e7925ab9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:41.419698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:41.480272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b4b9e-f647-42b3-aaab-6d25e7925ab9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:41.481718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b4b9e-f647-42b3-aaab-6d25e7925ab9 service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:41.502081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 565/1152] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:43.720607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78161-10a2-4ebb-a8e5-ebbffda98bb0 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:43.721141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78161-10a2-4ebb-a8e5-ebbffda98bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:43.721141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78161-10a2-4ebb-a8e5-ebbffda98bb0 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:43.722504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 588/1153] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:43.728406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8dc1d-5e1b-4283-8dde-babecc62ed6c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:43.728852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8dc1d-5e1b-4283-8dde-babecc62ed6c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:43.728948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8dc1d-5e1b-4283-8dde-babecc62ed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:43.804186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6ba8dc1d-5e1b-4283-8dde-babecc62ed6c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:43.805946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6ba8dc1d-5e1b-4283-8dde-babecc62ed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:43.926150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 566/1154] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:44.193929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa78161-10a2-4ebb-a8e5-ebbffda98bb0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:44.195554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-eaa78161-10a2-4ebb-a8e5-ebbffda98bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:44.330515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa78161-10a2-4ebb-a8e5-ebbffda98bb0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:44.382082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:44.429400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ba14b-e019-49ff-a1ef-581cdb95258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:44.430007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba14b-e019-49ff-a1ef-581cdb95258a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:44.430280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba14b-e019-49ff-a1ef-581cdb95258a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:44.430544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ba14b-e019-49ff-a1ef-581cdb95258a admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:44.431211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ba14b-e019-49ff-a1ef-581cdb95258a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:44.432322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-737ba14b-e019-49ff-a1ef-581cdb95258a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:54:44.432322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:54:44.432322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:54:44.434039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ba14b-e019-49ff-a1ef-581cdb95258a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:44.453819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 589/1155] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 11 11:54:44 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:54:46.657836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebf57-a632-426f-b059-03c83535b222 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:46.658482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebf57-a632-426f-b059-03c83535b222 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:46.658482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebf57-a632-426f-b059-03c83535b222 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:46.659898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 567/1156] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:46.666684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5d2a-c340-452d-ba85-44051f672fce None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:46.667175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5d2a-c340-452d-ba85-44051f672fce None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:46.667267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5d2a-c340-452d-ba85-44051f672fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:46.740305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b1ae5d2a-c340-452d-ba85-44051f672fce None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:46.741445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b1ae5d2a-c340-452d-ba85-44051f672fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:46.855217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 590/1157] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:47.156253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebf57-a632-426f-b059-03c83535b222 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:47.157868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cceebf57-a632-426f-b059-03c83535b222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:47.170056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:47.316335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebf57-a632-426f-b059-03c83535b222 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:47.403650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:47.439655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52772c-3051-411c-9955-88945203e66f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:47.440260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52772c-3051-411c-9955-88945203e66f service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:47.440576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52772c-3051-411c-9955-88945203e66f service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:47.440843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52772c-3051-411c-9955-88945203e66f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:47.442490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9f52772c-3051-411c-9955-88945203e66f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:47.545425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52772c-3051-411c-9955-88945203e66f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:47.547053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52772c-3051-411c-9955-88945203e66f service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:47.566212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 568/1158] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:49.971925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9682-8a48-43f1-9f23-f58a922d6d46 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:49.972526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9682-8a48-43f1-9f23-f58a922d6d46 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:49.972526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a9682-8a48-43f1-9f23-f58a922d6d46 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:49.973895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 591/1159] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:49.980113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358ce5-2a87-4d3b-b247-1f01fc3a91f9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:49.980698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358ce5-2a87-4d3b-b247-1f01fc3a91f9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:49.980698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b358ce5-2a87-4d3b-b247-1f01fc3a91f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:50.052948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3b358ce5-2a87-4d3b-b247-1f01fc3a91f9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:50.054157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3b358ce5-2a87-4d3b-b247-1f01fc3a91f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:50.107163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:50.168170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 569/1160] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:50.452777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a9682-8a48-43f1-9f23-f58a922d6d46 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:50.455282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cb5a9682-8a48-43f1-9f23-f58a922d6d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:50.482446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:50.572759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a9682-8a48-43f1-9f23-f58a922d6d46 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:50.656185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d94b61-2ca9-46eb-9704-73fb23766a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:50.656791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94b61-2ca9-46eb-9704-73fb23766a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:50.657069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94b61-2ca9-46eb-9704-73fb23766a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:50.657335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94b61-2ca9-46eb-9704-73fb23766a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:50.659004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-45d94b61-2ca9-46eb-9704-73fb23766a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:50.738282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:50.775510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94b61-2ca9-46eb-9704-73fb23766a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:50.776975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94b61-2ca9-46eb-9704-73fb23766a6a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:50.795720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 592/1161] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:53.024011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc70535-6cfc-40fa-9fe5-cc85b28e2031 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:53.024595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc70535-6cfc-40fa-9fe5-cc85b28e2031 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:53.024595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc70535-6cfc-40fa-9fe5-cc85b28e2031 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:53.025914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 570/1162] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:53.031762 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f247-839b-4f87-bc77-0344d78524a9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:53.032369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f247-839b-4f87-bc77-0344d78524a9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:53.032369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f247-839b-4f87-bc77-0344d78524a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:53.123954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9364f247-839b-4f87-bc77-0344d78524a9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:53.125243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9364f247-839b-4f87-bc77-0344d78524a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:53.239926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 593/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:54:53.537699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc70535-6cfc-40fa-9fe5-cc85b28e2031 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:53.539425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4bc70535-6cfc-40fa-9fe5-cc85b28e2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:53.664427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc70535-6cfc-40fa-9fe5-cc85b28e2031 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:53.743264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:53.744819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5769d6-05f0-4bd0-811b-e00d48013c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:53.745496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5769d6-05f0-4bd0-811b-e00d48013c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:53.745725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5769d6-05f0-4bd0-811b-e00d48013c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:53.746002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5769d6-05f0-4bd0-811b-e00d48013c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:53.748561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ec5769d6-05f0-4bd0-811b-e00d48013c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:53.866020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5769d6-05f0-4bd0-811b-e00d48013c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:53.867514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5769d6-05f0-4bd0-811b-e00d48013c85 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:53.887224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 571/1164] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:56.142609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1f57-d007-4022-9ca6-5db351920e47 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:56.143163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1f57-d007-4022-9ca6-5db351920e47 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:56.143163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1f57-d007-4022-9ca6-5db351920e47 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:56.144463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 594/1165] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:56.150375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5bda-fc90-4c91-9423-101e09a327b6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:56.151081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5bda-fc90-4c91-9423-101e09a327b6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:56.151081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5bda-fc90-4c91-9423-101e09a327b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:56.220988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6d9e5bda-fc90-4c91-9423-101e09a327b6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:56.222234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6d9e5bda-fc90-4c91-9423-101e09a327b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:56.280916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:56.335800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 572/1166] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:56.625330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb1f57-d007-4022-9ca6-5db351920e47 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:56.626922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-96bb1f57-d007-4022-9ca6-5db351920e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:56.669416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:56.746566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb1f57-d007-4022-9ca6-5db351920e47 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:54:56.840239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5f099-fc13-4073-8fbc-125b2c0545e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:54:56.840865 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f099-fc13-4073-8fbc-125b2c0545e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:56.841136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f099-fc13-4073-8fbc-125b2c0545e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:56.841401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f099-fc13-4073-8fbc-125b2c0545e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:56.843115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-45a5f099-fc13-4073-8fbc-125b2c0545e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:56.942023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:56.991847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5f099-fc13-4073-8fbc-125b2c0545e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:54:56.993425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5f099-fc13-4073-8fbc-125b2c0545e7 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:54:57.015850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 595/1167] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:54:59.468201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff0e80-5957-45be-9192-ffb32b407859 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:59.468778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff0e80-5957-45be-9192-ffb32b407859 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:59.468778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff0e80-5957-45be-9192-ffb32b407859 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:59.470118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 573/1168] 10.222.0.48 () {54 vars in 927 bytes} [Tue Oct 11 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:54:59.475954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3e4af-9163-4968-b505-b40a24d9ed61 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:54:59.476375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3e4af-9163-4968-b505-b40a24d9ed61 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:54:59.476489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3e4af-9163-4968-b505-b40a24d9ed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:54:59.552255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5bb3e4af-9163-4968-b505-b40a24d9ed61 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:54:59.553470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5bb3e4af-9163-4968-b505-b40a24d9ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:54:59.669840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 596/1169] 10.222.0.48 () {58 vars in 1024 bytes} [Tue Oct 11 11:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:54:59.958782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff0e80-5957-45be-9192-ffb32b407859 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:54:59.960357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-89ff0e80-5957-45be-9192-ffb32b407859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:55:00.076318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff0e80-5957-45be-9192-ffb32b407859 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:55:00.165120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c597c7-bdf5-40ed-80da-d9a4796e97a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:55:00.165120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c597c7-bdf5-40ed-80da-d9a4796e97a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:55:00.166877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c597c7-bdf5-40ed-80da-d9a4796e97a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:55:00.166877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c597c7-bdf5-40ed-80da-d9a4796e97a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:55:00.167677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-74c597c7-bdf5-40ed-80da-d9a4796e97a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:55:00.178946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:55:00.288877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c597c7-bdf5-40ed-80da-d9a4796e97a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:55:00.290265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c597c7-bdf5-40ed-80da-d9a4796e97a6 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:55:00.311893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 574/1170] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:55:09.668063 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=82 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:55:10.309282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=50 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:16.327710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:16.328344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:16.328344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:16.410016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:56:16.411254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:16.515722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 597/1171] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:56:16.523828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919571a-4f8e-4027-b703-790242a19990 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:16.524666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919571a-4f8e-4027-b703-790242a19990 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:16.524666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919571a-4f8e-4027-b703-790242a19990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:16.621597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1919571a-4f8e-4027-b703-790242a19990 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:56:16.623323 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1919571a-4f8e-4027-b703-790242a19990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:16.727691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 575/1172] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:56:16.732706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:16.733933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:16.745966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611561a-bff5-42c0-bf33-97acef5b5cdc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:16.815997 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:16.852676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:16.853293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:16.853569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:16.853831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:16.854481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:56:16.854812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:16.855826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:56:16.855826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:56:16.855826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:56:16.856713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:16.868761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 598/1173] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:56:16.878793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919571a-4f8e-4027-b703-790242a19990 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:16.888343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919571a-4f8e-4027-b703-790242a19990 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:16.954421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:16.991471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:16.992081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:16.992351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:16.992618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:16.993265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:16.994376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:56:16.994376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 11:56:16.994376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 11:56:16.995605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:17.059437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 576/1174] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:56:16 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:56:17.065704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:17.067398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:17.102883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e03b4-93d4-4f44-83ee-0acbdcede8cd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:17.207129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:17.207827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:17.208168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:17.208435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:17.209099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:17.210117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:56:17.210117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:56:17.210117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:56:17.211469 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:17.261622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 599/1175] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:56:17 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:56:17.266204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:17.267795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:17.334326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6561a4-760f-454b-91a8-1f642e58948a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:17.441113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:17.461403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:17.462364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:17.463059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:17.463477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:17.464664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:17.467955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:17.492028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 577/1176] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:56:17.497529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:17.500353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:17.518785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7abe8d-7b00-4ca1-b500-103ec4c27474 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:17.548463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:17.624947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c3b2b-54ff-4527-8888-6f6820ecd6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:17.625577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c3b2b-54ff-4527-8888-6f6820ecd6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:17.625846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c3b2b-54ff-4527-8888-6f6820ecd6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:17.626107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c3b2b-54ff-4527-8888-6f6820ecd6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:17.626777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c3b2b-54ff-4527-8888-6f6820ecd6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:17.628370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c3b2b-54ff-4527-8888-6f6820ecd6f4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:17.641207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 600/1177] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:56:17.646830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:17.648350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:17.683280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964b6c9-e2fe-47e5-a0b3-bf864c8a12b1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:17.795195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36424d4-7b49-4b27-9d60-4ef5279d0958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:17.795774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36424d4-7b49-4b27-9d60-4ef5279d0958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:17.796047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36424d4-7b49-4b27-9d60-4ef5279d0958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:17.796314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36424d4-7b49-4b27-9d60-4ef5279d0958 admin admin] PATH_INFO: `/v3/projects/5170ff772cca48a5a192790b69eccb4a/users/db98b160000c4cdfb1b20ed24c0bb16b/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:17.821358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36424d4-7b49-4b27-9d60-4ef5279d0958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5170ff772cca48a5a192790b69eccb4a, user_id=db98b160000c4cdfb1b20ed24c0bb16b, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:17.824128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36424d4-7b49-4b27-9d60-4ef5279d0958 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:17.850841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 578/1178] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:56:17 2022] PUT /identity/v3/projects/5170ff772cca48a5a192790b69eccb4a/users/db98b160000c4cdfb1b20ed24c0bb16b/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 11:56:17.862367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a2ac-8226-488f-af49-8db515f1acab None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:17.862711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a2ac-8226-488f-af49-8db515f1acab None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:17.862999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a2ac-8226-488f-af49-8db515f1acab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:17.924591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6f44a2ac-8226-488f-af49-8db515f1acab None None] MFA Rules not processed for user `db98b160000c4cdfb1b20ed24c0bb16b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:56:17.925824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6f44a2ac-8226-488f-af49-8db515f1acab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:18.011275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 601/1179] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:56:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:56:18.026076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4d1f5-76fd-4de1-bd01-db6dd581f1ea None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:18.026376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4d1f5-76fd-4de1-bd01-db6dd581f1ea None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:18.026667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4d1f5-76fd-4de1-bd01-db6dd581f1ea None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:18.028103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 579/1180] 10.222.0.48 () {54 vars in 963 bytes} [Tue Oct 11 11:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:56:18.033582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e8f5-922c-4947-9971-bec3a826e5a8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:18.033883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e8f5-922c-4947-9971-bec3a826e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:18.034153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56e8f5-922c-4947-9971-bec3a826e5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:18.068505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:18.117737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-dd56e8f5-922c-4947-9971-bec3a826e5a8 None None] MFA Rules not processed for user `bb63e30c48464c1ebe9305c620291c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:56:18.118714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dd56e8f5-922c-4947-9971-bec3a826e5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:18.206050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 602/1181] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Oct 11 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:56:18.215897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4d1f5-76fd-4de1-bd01-db6dd581f1ea None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:18.217706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-81a4d1f5-76fd-4de1-bd01-db6dd581f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:18.283404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:18.343594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4d1f5-76fd-4de1-bd01-db6dd581f1ea None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:18.423071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:18.423661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:18.423930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:18.424215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:18.425871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:18.532647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:18.534106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:18.537866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:18.555083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 580/1182] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:56:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:56:18.602181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca0cd-a797-44fd-be67-89d5d73b1f65 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:18.602649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca0cd-a797-44fd-be67-89d5d73b1f65 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:18.602801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fca0cd-a797-44fd-be67-89d5d73b1f65 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:18.604108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 603/1183] 10.222.0.48 () {52 vars in 830 bytes} [Tue Oct 11 11:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:56:18.607999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:18.609251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:18.716014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0a45e-7052-4aa5-a735-d727e1d3cc0a service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:18.814935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08707b38-286a-449d-9771-f670184af668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:18.815606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08707b38-286a-449d-9771-f670184af668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:18.815879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08707b38-286a-449d-9771-f670184af668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:18.816139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08707b38-286a-449d-9771-f670184af668 admin admin] PATH_INFO: `/v3/users/db98b160000c4cdfb1b20ed24c0bb16b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:18.830858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08707b38-286a-449d-9771-f670184af668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db98b160000c4cdfb1b20ed24c0bb16b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:18.831870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-08707b38-286a-449d-9771-f670184af668 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:56:18.831870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 11:56:18.831870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 11:56:18.833129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08707b38-286a-449d-9771-f670184af668 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:18.843696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:18.916743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db98b160000c4cdfb1b20ed24c0bb16b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:18.917304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db98b160000c4cdfb1b20ed24c0bb16b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:18.945473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db98b160000c4cdfb1b20ed24c0bb16b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:18.963533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db98b160000c4cdfb1b20ed24c0bb16b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:18.964243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db98b160000c4cdfb1b20ed24c0bb16b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:18.983642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 581/1184] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 11:56:18 2022] DELETE /identity/v3/users/db98b160000c4cdfb1b20ed24c0bb16b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:56:18.988082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:18.988362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:18.988638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:19.054543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:56:19.055800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:19.139064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:19.154271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 604/1185] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:56:19.165463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:19.167102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:19.289023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08707b38-286a-449d-9771-f670184af668 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:19.348222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:19.370208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab142a42-77d5-4002-8f7a-fa142ee9c291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:19.370862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab142a42-77d5-4002-8f7a-fa142ee9c291 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:19.371162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab142a42-77d5-4002-8f7a-fa142ee9c291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:19.371429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab142a42-77d5-4002-8f7a-fa142ee9c291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:19.373078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ab142a42-77d5-4002-8f7a-fa142ee9c291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:19.491707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab142a42-77d5-4002-8f7a-fa142ee9c291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:19.493071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab142a42-77d5-4002-8f7a-fa142ee9c291 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:19.511897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 582/1186] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:56:19.857508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:56:19.859260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:56:19.871614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16728f-784d-47b6-9f51-80d04a12bc3a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:56:19.980171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:56:19.980834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:56:19.981115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:56:19.981381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] PATH_INFO: `/v3/projects/5170ff772cca48a5a192790b69eccb4a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:56:19.993074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5170ff772cca48a5a192790b69eccb4a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:56:19.994233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:56:19.994233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:56:19.994233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:56:19.995491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:56:20.059869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5170ff772cca48a5a192790b69eccb4a', 'request_id': 'req-f377f3a8-af5b-4362-96af-100a5f325fcf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:20.074249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5170ff772cca48a5a192790b69eccb4a', 'request_id': 'req-f377f3a8-af5b-4362-96af-100a5f325fcf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:20.085682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5170ff772cca48a5a192790b69eccb4a', 'request_id': 'req-f377f3a8-af5b-4362-96af-100a5f325fcf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:20.116731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] The token cache is being invalidate because project 5170ff772cca48a5a192790b69eccb4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 11:56:20.117040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:20.117448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f377f3a8-af5b-4362-96af-100a5f325fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 11:56:20.118958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 605/1187] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 11:56:19 2022] DELETE /identity/v3/projects/5170ff772cca48a5a192790b69eccb4a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:56:29.509597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=62 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:56:30.114237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:57:54.823581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfbc6d-ef6e-4386-b8a7-245b12476f4f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:54.824279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfbc6d-ef6e-4386-b8a7-245b12476f4f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:54.824279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfbc6d-ef6e-4386-b8a7-245b12476f4f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:54.825562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 583/1188] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:57:54.831538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461dde-8031-4a12-81de-093076c0f7a9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:54.832253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461dde-8031-4a12-81de-093076c0f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:54.832462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461dde-8031-4a12-81de-093076c0f7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:54.940004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fc461dde-8031-4a12-81de-093076c0f7a9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:57:54.941239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fc461dde-8031-4a12-81de-093076c0f7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:57:55.051794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 606/1189] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:57:55.215298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfbc6d-ef6e-4386-b8a7-245b12476f4f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:57:55.217666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-04bfbc6d-ef6e-4386-b8a7-245b12476f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:57:55.345959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfbc6d-ef6e-4386-b8a7-245b12476f4f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:57:55.352177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6df30-78f6-466b-aa34-e09f76e62281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:57:55.352795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6df30-78f6-466b-aa34-e09f76e62281 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:55.353150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6df30-78f6-466b-aa34-e09f76e62281 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:55.353342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6df30-78f6-466b-aa34-e09f76e62281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:55.370894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6df30-78f6-466b-aa34-e09f76e62281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:57:55.374892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6df30-78f6-466b-aa34-e09f76e62281 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:57:55.395518 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 584/1190] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:57:56.545828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c7a31-a5fd-4364-9b03-cb724695d3f5 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:56.546423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c7a31-a5fd-4364-9b03-cb724695d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:56.546423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c7a31-a5fd-4364-9b03-cb724695d3f5 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:56.547815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 607/1191] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:57:56.555225 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a58b-435b-45d1-9d27-9765e8254fa0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:56.555771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a58b-435b-45d1-9d27-9765e8254fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:56.555771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a58b-435b-45d1-9d27-9765e8254fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:56.581742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-38a2a58b-435b-45d1-9d27-9765e8254fa0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:57:56.583084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-38a2a58b-435b-45d1-9d27-9765e8254fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:57:56.592036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 585/1192] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:57:56.744036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c7a31-a5fd-4364-9b03-cb724695d3f5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:57:56.762701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c7a31-a5fd-4364-9b03-cb724695d3f5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:57:56.775447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202eda4a-3826-4771-9a51-acdc6a2c81fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:57:56.776072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eda4a-3826-4771-9a51-acdc6a2c81fb service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:56.776347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eda4a-3826-4771-9a51-acdc6a2c81fb service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:56.776606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eda4a-3826-4771-9a51-acdc6a2c81fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:56.786116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eda4a-3826-4771-9a51-acdc6a2c81fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:57:56.787744 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202eda4a-3826-4771-9a51-acdc6a2c81fb service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:57:56.798601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 608/1193] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:57:56.953406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb6a8-1ff5-48ee-87d6-8441bb311db9 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:56.953696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb6a8-1ff5-48ee-87d6-8441bb311db9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:56.954051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb6a8-1ff5-48ee-87d6-8441bb311db9 None None] PATH_INFO: `/v3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:56.956085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 586/1194] 10.222.0.46 () {54 vars in 925 bytes} [Tue Oct 11 11:57:56 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:57:56.962516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54d32-231c-4e03-b9e3-2e98f5ac5ddf None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:57:56.963030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54d32-231c-4e03-b9e3-2e98f5ac5ddf None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:57:56.963176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54d32-231c-4e03-b9e3-2e98f5ac5ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:57:57.027977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4dd54d32-231c-4e03-b9e3-2e98f5ac5ddf None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:57:57.029076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4dd54d32-231c-4e03-b9e3-2e98f5ac5ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:57:57.047564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:57:57.110947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 609/1195] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Oct 11 11:57:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:58:00.717494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717a6c-27ef-4497-a1d0-54ba8fbd6a44 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:00.717976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717a6c-27ef-4497-a1d0-54ba8fbd6a44 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:00.718086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717a6c-27ef-4497-a1d0-54ba8fbd6a44 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:00.719476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 587/1196] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 11 11:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:58:00.724792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697772b-00ba-4050-bee7-10d38f68c3d1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:00.725204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697772b-00ba-4050-bee7-10d38f68c3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:00.725317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697772b-00ba-4050-bee7-10d38f68c3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:00.746715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8697772b-00ba-4050-bee7-10d38f68c3d1 None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:58:00.747945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8697772b-00ba-4050-bee7-10d38f68c3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:00.757468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 610/1197] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 11 11:58:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:58:00.765450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717a6c-27ef-4497-a1d0-54ba8fbd6a44 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:58:00.780079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717a6c-27ef-4497-a1d0-54ba8fbd6a44 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:58:00.786886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bc7b8-9f36-4526-b334-584598c5dacf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:58:00.787503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bc7b8-9f36-4526-b334-584598c5dacf service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:00.787761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bc7b8-9f36-4526-b334-584598c5dacf service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:00.788029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bc7b8-9f36-4526-b334-584598c5dacf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:00.798084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bc7b8-9f36-4526-b334-584598c5dacf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:58:00.799721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bc7b8-9f36-4526-b334-584598c5dacf service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:58:00.810988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 588/1198] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:58:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:58:08.295581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef94b-954c-43e0-8159-3aaab7d63a53 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:08.296122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef94b-954c-43e0-8159-3aaab7d63a53 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:08.296122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef94b-954c-43e0-8159-3aaab7d63a53 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:08.297412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 611/1199] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:58:08.304583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4862476-b2a4-496c-b469-22079847f470 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:08.305170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4862476-b2a4-496c-b469-22079847f470 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:08.305170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4862476-b2a4-496c-b469-22079847f470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:08.325376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b4862476-b2a4-496c-b469-22079847f470 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:58:08.326620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b4862476-b2a4-496c-b469-22079847f470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:08.335115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 589/1200] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:58:08.487490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef94b-954c-43e0-8159-3aaab7d63a53 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:58:08.503780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef94b-954c-43e0-8159-3aaab7d63a53 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:58:08.510128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b2395-3f22-4956-bc54-d0036be78bc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:58:08.510752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2395-3f22-4956-bc54-d0036be78bc7 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:08.511026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2395-3f22-4956-bc54-d0036be78bc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:08.511289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2395-3f22-4956-bc54-d0036be78bc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:08.520130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b2395-3f22-4956-bc54-d0036be78bc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:58:08.521714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b2395-3f22-4956-bc54-d0036be78bc7 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:58:08.532083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 612/1201] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:58:09.612031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357c57-44d3-488d-b60d-daed1db21b9d None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:09.612721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357c57-44d3-488d-b60d-daed1db21b9d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:09.612721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28357c57-44d3-488d-b60d-daed1db21b9d None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:09.613927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 590/1202] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 11 11:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:58:09.620909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ca91-b687-49a3-82a7-11f19e4457fe None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:09.621477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ca91-b687-49a3-82a7-11f19e4457fe None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:09.621477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ca91-b687-49a3-82a7-11f19e4457fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:09.647197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7ab5ca91-b687-49a3-82a7-11f19e4457fe None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:58:09.648477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7ab5ca91-b687-49a3-82a7-11f19e4457fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:09.658122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 613/1203] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 11 11:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:58:09.813291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28357c57-44d3-488d-b60d-daed1db21b9d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:58:09.831718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28357c57-44d3-488d-b60d-daed1db21b9d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:58:09.837749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deae9cc-cdd3-42cf-903b-77891920c05d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:58:09.838363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deae9cc-cdd3-42cf-903b-77891920c05d service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:09.838678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deae9cc-cdd3-42cf-903b-77891920c05d service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:09.838955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deae9cc-cdd3-42cf-903b-77891920c05d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:09.847808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deae9cc-cdd3-42cf-903b-77891920c05d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:58:09.849403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deae9cc-cdd3-42cf-903b-77891920c05d service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:58:09.859251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 591/1204] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:58:13.884209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44510-1d87-4631-9a56-244654fe4138 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:13.884740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44510-1d87-4631-9a56-244654fe4138 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:13.884740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44510-1d87-4631-9a56-244654fe4138 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:13.886657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 614/1205] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:58:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:58:13.894723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f80ea-ff8e-4520-b958-c6e4a5b39a7c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:13.895208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f80ea-ff8e-4520-b958-c6e4a5b39a7c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:13.895208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f80ea-ff8e-4520-b958-c6e4a5b39a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:13.919003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4d3f80ea-ff8e-4520-b958-c6e4a5b39a7c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:58:13.920211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d3f80ea-ff8e-4520-b958-c6e4a5b39a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:13.928819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 592/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:58:14.222382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44510-1d87-4631-9a56-244654fe4138 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:58:14.224319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-87b44510-1d87-4631-9a56-244654fe4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:14.316344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44510-1d87-4631-9a56-244654fe4138 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:58:14.320564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7f71c-0c81-47eb-951e-5fa3d16dd04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:58:14.321282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f71c-0c81-47eb-951e-5fa3d16dd04c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:14.321679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f71c-0c81-47eb-951e-5fa3d16dd04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:14.322058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f71c-0c81-47eb-951e-5fa3d16dd04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:14.332777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7f71c-0c81-47eb-951e-5fa3d16dd04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:58:14.334238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7f71c-0c81-47eb-951e-5fa3d16dd04c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:58:14.344349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 615/1207] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:58:16.503964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ecd7-ae10-424d-a6a2-4e90096a4ee1 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:16.504658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ecd7-ae10-424d-a6a2-4e90096a4ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:16.504658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ecd7-ae10-424d-a6a2-4e90096a4ee1 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:16.505855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 593/1208] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:58:16.511631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7c76-61f0-45c0-8ff8-957dcfa94fa8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:16.512102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7c76-61f0-45c0-8ff8-957dcfa94fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:16.512199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7c76-61f0-45c0-8ff8-957dcfa94fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:16.532100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-206f7c76-61f0-45c0-8ff8-957dcfa94fa8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:58:16.533305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-206f7c76-61f0-45c0-8ff8-957dcfa94fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:16.542156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 616/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:58:16.829617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960ecd7-ae10-424d-a6a2-4e90096a4ee1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:58:16.841620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960ecd7-ae10-424d-a6a2-4e90096a4ee1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:58:16.845822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a3cba-9b1b-4eed-aaac-929677c69c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:58:16.846475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3cba-9b1b-4eed-aaac-929677c69c83 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:16.846770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3cba-9b1b-4eed-aaac-929677c69c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:16.847033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a3cba-9b1b-4eed-aaac-929677c69c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:16.858701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3cba-9b1b-4eed-aaac-929677c69c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:58:16.860178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a3cba-9b1b-4eed-aaac-929677c69c83 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:58:16.871154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 594/1210] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:58:20.592130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1955c4-e612-4d06-bc63-96ec9b2ff68a None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:20.592890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1955c4-e612-4d06-bc63-96ec9b2ff68a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:20.592890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1955c4-e612-4d06-bc63-96ec9b2ff68a None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:20.594397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 617/1211] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:58:20.599619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a00b8b-a76f-49fc-a1e1-8e9f1885678d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:20.600042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a00b8b-a76f-49fc-a1e1-8e9f1885678d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:20.600042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a00b8b-a76f-49fc-a1e1-8e9f1885678d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:20.608122 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=81 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:58:20.621895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-39a00b8b-a76f-49fc-a1e1-8e9f1885678d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:58:20.623137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-39a00b8b-a76f-49fc-a1e1-8e9f1885678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:20.631581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 595/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:58:20.938775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1955c4-e612-4d06-bc63-96ec9b2ff68a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:58:20.942048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8f1955c4-e612-4d06-bc63-96ec9b2ff68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:21.016121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:58:21.034261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1955c4-e612-4d06-bc63-96ec9b2ff68a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:58:21.040670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a56d49-7a3c-40de-a52a-82d7ec2c85b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:58:21.041323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56d49-7a3c-40de-a52a-82d7ec2c85b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:21.041600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56d49-7a3c-40de-a52a-82d7ec2c85b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:21.041867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a56d49-7a3c-40de-a52a-82d7ec2c85b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:21.052675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56d49-7a3c-40de-a52a-82d7ec2c85b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:58:21.054104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a56d49-7a3c-40de-a52a-82d7ec2c85b4 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:58:21.064019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 618/1213] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:58:23.215610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41716d1-931f-40f2-809d-1935c8f0fea1 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:23.216191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41716d1-931f-40f2-809d-1935c8f0fea1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:23.216191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41716d1-931f-40f2-809d-1935c8f0fea1 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:23.217502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 596/1214] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 11 11:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:58:23.223181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9ffd-b2f9-4947-973b-7769b444aa80 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:23.223604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9ffd-b2f9-4947-973b-7769b444aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:23.223710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9ffd-b2f9-4947-973b-7769b444aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:23.246251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d74d9ffd-b2f9-4947-973b-7769b444aa80 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:58:23.248308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d74d9ffd-b2f9-4947-973b-7769b444aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:23.261257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 619/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 11 11:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:58:23.561368 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41716d1-931f-40f2-809d-1935c8f0fea1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:58:23.563962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b41716d1-931f-40f2-809d-1935c8f0fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:58:23.584711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41716d1-931f-40f2-809d-1935c8f0fea1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:58:23.588962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca1b3f-a6eb-4606-840f-82eac9edce8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:58:23.589566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca1b3f-a6eb-4606-840f-82eac9edce8e service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:58:23.589842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca1b3f-a6eb-4606-840f-82eac9edce8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:58:23.590108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca1b3f-a6eb-4606-840f-82eac9edce8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:58:23.599619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca1b3f-a6eb-4606-840f-82eac9edce8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:58:23.601052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca1b3f-a6eb-4606-840f-82eac9edce8e service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:58:23.610797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 597/1216] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:58:33.239134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=11 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:58:33.606801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:51.860270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb6aa0-6c05-4740-8aa2-25d47e5501eb None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:51.861254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb6aa0-6c05-4740-8aa2-25d47e5501eb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:51.861254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb6aa0-6c05-4740-8aa2-25d47e5501eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:51.887871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e2cb6aa0-6c05-4740-8aa2-25d47e5501eb None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:51.889217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e2cb6aa0-6c05-4740-8aa2-25d47e5501eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:51.908401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 620/1217] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:51.919840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6229-c47e-4c4e-9c88-d64ca46fe281 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:51.920702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6229-c47e-4c4e-9c88-d64ca46fe281 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:51.920702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6229-c47e-4c4e-9c88-d64ca46fe281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:51.949080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-73fc6229-c47e-4c4e-9c88-d64ca46fe281 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:51.950547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-73fc6229-c47e-4c4e-9c88-d64ca46fe281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:51.966730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 598/1218] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:59:51.972117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb6aa0-6c05-4740-8aa2-25d47e5501eb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:51.990711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb6aa0-6c05-4740-8aa2-25d47e5501eb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.007529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f240-cc98-45ac-adb2-6234f5c97c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.008185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f240-cc98-45ac-adb2-6234f5c97c87 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.008474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f240-cc98-45ac-adb2-6234f5c97c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.008792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f240-cc98-45ac-adb2-6234f5c97c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.009425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f240-cc98-45ac-adb2-6234f5c97c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:52.009727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f240-cc98-45ac-adb2-6234f5c97c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.014601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f240-cc98-45ac-adb2-6234f5c97c87 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.026811 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 621/1219] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:52.044905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6229-c47e-4c4e-9c88-d64ca46fe281 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.068053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6229-c47e-4c4e-9c88-d64ca46fe281 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.081100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.082363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.082965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.083388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.084966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.088953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.153065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f7b84-e9f1-47e4-94e6-851e591f0e85 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.153065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f7b84-e9f1-47e4-94e6-851e591f0e85 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.153776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f7b84-e9f1-47e4-94e6-851e591f0e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.187299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 599/1220] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:52.193975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.200006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-789f7b84-e9f1-47e4-94e6-851e591f0e85 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:52.201263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-789f7b84-e9f1-47e4-94e6-851e591f0e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:52.352248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715bba9-c539-4561-b97b-45d5d07d0178 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.356708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 622/1221] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:52.370402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.371194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.371685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.372155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.373316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.375341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:59:52.375341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 11:59:52.375341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 11:59:52.378255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.415797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847a62-b27f-4086-b681-4819e1ab4a82 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.416383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847a62-b27f-4086-b681-4819e1ab4a82 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.416804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847a62-b27f-4086-b681-4819e1ab4a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.457178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 600/1222] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:52.471287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.485331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4a847a62-b27f-4086-b681-4819e1ab4a82 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:52.487524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4a847a62-b27f-4086-b681-4819e1ab4a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:52.493010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eefd7f-be2b-41c3-bc67-d8a983bca803 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.505659 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.506302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.506662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.506849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.507519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.509187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.512792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 623/1223] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:59:52.514880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ca09-d583-410c-aedd-b334d3dfc975 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.515270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ca09-d583-410c-aedd-b334d3dfc975 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.515564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655ca09-d583-410c-aedd-b334d3dfc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.534261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 601/1224] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:52.535283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.550128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bdcf9-55c1-4280-b4ac-172abb7c2ba1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.560858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e655ca09-d583-410c-aedd-b334d3dfc975 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:52.562467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e655ca09-d583-410c-aedd-b334d3dfc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:52.567615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.568271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.568543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.568928 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.569615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:52.569917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.571054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:59:52.571054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 11:59:52.571054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 11:59:52.571983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4d103-79c1-4b87-baf5-be20ebca8c7f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.579378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 624/1225] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 11:59:52.581172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655ca09-d583-410c-aedd-b334d3dfc975 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.602259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 602/1226] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:52.603982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d823190-79cf-4e85-b448-f59c036f704b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.604389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d823190-79cf-4e85-b448-f59c036f704b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.604569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d823190-79cf-4e85-b448-f59c036f704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.609050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655ca09-d583-410c-aedd-b334d3dfc975 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.628574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.631166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.638478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.639659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.641809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.668006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.672151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5d823190-79cf-4e85-b448-f59c036f704b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:52.673438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5d823190-79cf-4e85-b448-f59c036f704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:52.695322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 625/1227] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:52.697310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.704643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 603/1228] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:52.705426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d823190-79cf-4e85-b448-f59c036f704b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.728629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d823190-79cf-4e85-b448-f59c036f704b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.742520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3aed6-d26b-4b29-8c13-e4e3e08bc0e5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:52.745116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.745868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.746149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.746415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] PATH_INFO: `/v3/projects/4dcc4bb0f4b8456a9126207845b0dc7a/users/62e872a76ae44efb845dc3a62b783492/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.768268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786840-4eb5-47c1-bb50-6e260c86d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:52.771496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786840-4eb5-47c1-bb50-6e260c86d708 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.772571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786840-4eb5-47c1-bb50-6e260c86d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.773551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786840-4eb5-47c1-bb50-6e260c86d708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.775120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91786840-4eb5-47c1-bb50-6e260c86d708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.777324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-91786840-4eb5-47c1-bb50-6e260c86d708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 11:59:52.777324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 11:59:52.777324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 11:59:52.786607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91786840-4eb5-47c1-bb50-6e260c86d708 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.794342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dcc4bb0f4b8456a9126207845b0dc7a, user_id=62e872a76ae44efb845dc3a62b783492, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:52.797494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:52.835944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 604/1229] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:52 2022] PUT /identity/v3/projects/4dcc4bb0f4b8456a9126207845b0dc7a/users/62e872a76ae44efb845dc3a62b783492/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:52.835944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:52.868808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 626/1230] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:52.870438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0817-9188-4a87-bae0-530eaf8c3c96 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:52.870775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0817-9188-4a87-bae0-530eaf8c3c96 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:52.871041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e0817-9188-4a87-bae0-530eaf8c3c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:52.930719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cd4e0817-9188-4a87-bae0-530eaf8c3c96 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:52.931932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cd4e0817-9188-4a87-bae0-530eaf8c3c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.004417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:53.017463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08558429-6b75-4fd9-90e5-8dc80812060f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.064820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 627/1231] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.069381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e0817-9188-4a87-bae0-530eaf8c3c96 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.095096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e0817-9188-4a87-bae0-530eaf8c3c96 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.101426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6c691-9a1e-4bcb-94a8-f44106d93cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.103236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c691-9a1e-4bcb-94a8-f44106d93cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.103699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c691-9a1e-4bcb-94a8-f44106d93cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.104133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c691-9a1e-4bcb-94a8-f44106d93cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.104981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6c691-9a1e-4bcb-94a8-f44106d93cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.108037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6c691-9a1e-4bcb-94a8-f44106d93cf4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.139955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 628/1232] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/users => generated 290 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:53.142204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98016c02-e9eb-472e-884b-0bc2f9f8e155 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.142769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98016c02-e9eb-472e-884b-0bc2f9f8e155 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.143170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98016c02-e9eb-472e-884b-0bc2f9f8e155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.149981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3aba28-975b-4908-8fde-837cdd417848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.151307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aba28-975b-4908-8fde-837cdd417848 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.151914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aba28-975b-4908-8fde-837cdd417848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.152489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3aba28-975b-4908-8fde-837cdd417848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.153956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aba28-975b-4908-8fde-837cdd417848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:53.155408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aba28-975b-4908-8fde-837cdd417848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.158775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3aba28-975b-4908-8fde-837cdd417848 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.170089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-98016c02-e9eb-472e-884b-0bc2f9f8e155 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.171889 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-98016c02-e9eb-472e-884b-0bc2f9f8e155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.184423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 605/1234] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:53.184740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 629/1234] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.186306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.187019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.187377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69eac-6f23-4600-b13b-40a8de68884b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.187620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.188141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69eac-6f23-4600-b13b-40a8de68884b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.189091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69eac-6f23-4600-b13b-40a8de68884b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.215698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.217324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.229157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6df69eac-6f23-4600-b13b-40a8de68884b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.229780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 630/1235] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.230875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.232102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6df69eac-6f23-4600-b13b-40a8de68884b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.232642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.240944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:53.248472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 606/1236] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.250597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df69eac-6f23-4600-b13b-40a8de68884b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.270299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df69eac-6f23-4600-b13b-40a8de68884b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.279368 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.280818 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.281283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.282154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.283481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.285844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.303560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 607/1237] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:53.304558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.319684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775478c-52e8-408b-836e-b6141e7a6c90 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.326688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd301688-a935-4dba-a610-0246a4a009ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.327726 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301688-a935-4dba-a610-0246a4a009ec admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.328126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301688-a935-4dba-a610-0246a4a009ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.328537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd301688-a935-4dba-a610-0246a4a009ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.329556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301688-a935-4dba-a610-0246a4a009ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.332819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794dc95-f4ff-405e-8aa3-7ac39b7bd0c1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.333004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd301688-a935-4dba-a610-0246a4a009ec admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.338969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bebfb-2fca-4ee4-a214-0438303b242c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.339915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bebfb-2fca-4ee4-a214-0438303b242c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.340246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bebfb-2fca-4ee4-a214-0438303b242c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.340671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bebfb-2fca-4ee4-a214-0438303b242c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.353436 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bebfb-2fca-4ee4-a214-0438303b242c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.355386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bebfb-2fca-4ee4-a214-0438303b242c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.368122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 631/1238] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:59:53.369250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269220c-9c05-4737-a77f-b87efc1a048d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.369496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269220c-9c05-4737-a77f-b87efc1a048d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.369768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269220c-9c05-4737-a77f-b87efc1a048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.371893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 608/1239] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:53.374150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9b7a-fc3a-4d88-8bd0-b6c8bad21536 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.374945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9b7a-fc3a-4d88-8bd0-b6c8bad21536 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.375692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9b7a-fc3a-4d88-8bd0-b6c8bad21536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.395444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7269220c-9c05-4737-a77f-b87efc1a048d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.397159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7269220c-9c05-4737-a77f-b87efc1a048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.409399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9a5d9b7a-fc3a-4d88-8bd0-b6c8bad21536 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.411842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9a5d9b7a-fc3a-4d88-8bd0-b6c8bad21536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.479993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 632/1240] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.483548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae087d3-9358-4a53-a6d4-e5fad644711f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.484655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae087d3-9358-4a53-a6d4-e5fad644711f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.485029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae087d3-9358-4a53-a6d4-e5fad644711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.516431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 609/1241] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.521366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6fb3-1e91-4582-944d-3a8223ef6853 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.521934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6fb3-1e91-4582-944d-3a8223ef6853 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.522440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a6fb3-1e91-4582-944d-3a8223ef6853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.534037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-dae087d3-9358-4a53-a6d4-e5fad644711f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.536066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dae087d3-9358-4a53-a6d4-e5fad644711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.552282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-308a6fb3-1e91-4582-944d-3a8223ef6853 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.552974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-308a6fb3-1e91-4582-944d-3a8223ef6853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.553599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 633/1242] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.556058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f121ff-0a8e-4963-bedd-1d14922f2cc9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.556510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f121ff-0a8e-4963-bedd-1d14922f2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.557042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f121ff-0a8e-4963-bedd-1d14922f2cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.565910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 610/1243] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.566604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a6fb3-1e91-4582-944d-3a8223ef6853 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.577129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a6fb3-1e91-4582-944d-3a8223ef6853 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.583074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-38f121ff-0a8e-4963-bedd-1d14922f2cc9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.583793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.584831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.585361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.585507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-38f121ff-0a8e-4963-bedd-1d14922f2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.585855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.587160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.590118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.606924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 634/1244] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.606924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f121ff-0a8e-4963-bedd-1d14922f2cc9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.608285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 611/1245] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:53.609625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.627190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f121ff-0a8e-4963-bedd-1d14922f2cc9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.628436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cda5f9-be17-4fe6-8dc8-80f952761ac2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.635112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d71460-9293-4d8b-9359-801124ddaa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.635748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71460-9293-4d8b-9359-801124ddaa7f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.636027 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71460-9293-4d8b-9359-801124ddaa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.636294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71460-9293-4d8b-9359-801124ddaa7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.637004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d71460-9293-4d8b-9359-801124ddaa7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:53.637267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.637414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d71460-9293-4d8b-9359-801124ddaa7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.638722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.639004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d71460-9293-4d8b-9359-801124ddaa7f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.639423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.640033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.642494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.646919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.653448 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 612/1246] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:53.661420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed82dd-872c-4e67-a285-db0ef1653748 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.661420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed82dd-872c-4e67-a285-db0ef1653748 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.661420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed82dd-872c-4e67-a285-db0ef1653748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.685244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-32ed82dd-872c-4e67-a285-db0ef1653748 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.686655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-32ed82dd-872c-4e67-a285-db0ef1653748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.700419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 613/1247] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.700419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed82dd-872c-4e67-a285-db0ef1653748 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.709866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 635/1248] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:53.709866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.710849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed82dd-872c-4e67-a285-db0ef1653748 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.717080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.717899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.718200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.718617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.721656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:53.721964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.723727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.732183 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cdeda-6184-4057-9a17-6fb993e5a01d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.743335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 614/1249] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:53.743848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ed16f-8421-45b5-82dd-9db747e907ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.745141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed16f-8421-45b5-82dd-9db747e907ee admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.745821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed16f-8421-45b5-82dd-9db747e907ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.746476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ed16f-8421-45b5-82dd-9db747e907ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.747099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.748058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ed16f-8421-45b5-82dd-9db747e907ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:53.748667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ed16f-8421-45b5-82dd-9db747e907ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.752337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ed16f-8421-45b5-82dd-9db747e907ee admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.770318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45ceca-cf8f-4c7b-9fd0-57951b73b8b5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:53.777697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:53.778709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.779121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.779504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] PATH_INFO: `/v3/projects/30cdbda9e6e44631ae86ef4733bc2418/users/d35bcd2d840a4fd4be9c0ac0fff6d6e9/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.783638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 636/1250] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:53.784968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:53.788657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580a67-d57b-4f16-9848-9333d65cc2d9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:53.789656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580a67-d57b-4f16-9848-9333d65cc2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:53.790468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580a67-d57b-4f16-9848-9333d65cc2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:53.806098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cdbda9e6e44631ae86ef4733bc2418, user_id=d35bcd2d840a4fd4be9c0ac0fff6d6e9, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:53.817362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:53.833560 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a8580a67-d57b-4f16-9848-9333d65cc2d9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:53.835790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a8580a67-d57b-4f16-9848-9333d65cc2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:53.842114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 615/1251] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:53 2022] PUT /identity/v3/projects/30cdbda9e6e44631ae86ef4733bc2418/users/d35bcd2d840a4fd4be9c0ac0fff6d6e9/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:53.842114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.965281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 637/1252] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:53.971443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8580a67-d57b-4f16-9848-9333d65cc2d9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:53.992097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:54.004688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8580a67-d57b-4f16-9848-9333d65cc2d9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.018022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.019050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def0d3f-d551-4910-bf59-7f26645c821f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.019780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.019780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.020117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.021287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:54.024269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.025295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.026044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.026420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.026875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.027528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.027716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.029545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.054907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 638/1253] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:54.056717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.074604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 616/1254] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:53 2022] POST /identity/v3/projects => generated 389 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.075506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.079502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760c9d-9a1b-42f3-8f98-ac76cdb801c4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.200008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b58b-079b-45f8-8970-844fad7460de admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.203181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.204297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.204775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.205253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.206477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.208710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec911a-0ae8-4c3b-bcd2-351bdbc0dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.209662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.210030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec911a-0ae8-4c3b-bcd2-351bdbc0dbdd admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.210661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec911a-0ae8-4c3b-bcd2-351bdbc0dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.211251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec911a-0ae8-4c3b-bcd2-351bdbc0dbdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.212610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec911a-0ae8-4c3b-bcd2-351bdbc0dbdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.216540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec911a-0ae8-4c3b-bcd2-351bdbc0dbdd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.233375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 639/1255] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:54.233375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.251856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1ca4c-4235-4f34-867b-1e1a351e0c17 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.260627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.261814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.262394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.263004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.264325 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.268351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.277241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 617/1256] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.277241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61335d5-185e-42a8-9ea0-8bee2a60de1a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.277241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61335d5-185e-42a8-9ea0-8bee2a60de1a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.277699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61335d5-185e-42a8-9ea0-8bee2a60de1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.312471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b61335d5-185e-42a8-9ea0-8bee2a60de1a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:54.314618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b61335d5-185e-42a8-9ea0-8bee2a60de1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:54.321181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 640/1257] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.323088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.380247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:54.400961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 618/1258] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:54.402502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61335d5-185e-42a8-9ea0-8bee2a60de1a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.416221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5239e-caac-4fc1-bcb4-baf51a12d555 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.422625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.423451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.423631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61335d5-185e-42a8-9ea0-8bee2a60de1a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.423805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.424208 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.425022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 11:59:54.425473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.427437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.437521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.437756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.438075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.438248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.439147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.441129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.451161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 641/1259] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 11:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 11:59:54.453493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.470577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039da5a5-95a7-47bb-ae64-c545e6ba42e4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.479152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.480275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.481079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.481536 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.483129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.487034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.498803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 619/1260] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.498803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.524686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 642/1261] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/users => generated 295 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.526129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.558095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c763a-305f-49fe-8909-7831a0c1cb50 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.598633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e14ca5-4481-4795-b406-79d618c9d8a2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.604183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.604542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.604868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.605031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.605675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.607654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.622231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 620/1262] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:54.623270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.638420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09849d-c3b4-46b4-b099-dffcae9e9238 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.646057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.647832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.648189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.648439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.649217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.652631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.698785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:54.699795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 621/1263] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/users => generated 289 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.700895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.749287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.751119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.751539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.751916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.752764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.756461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.823942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 643/1264] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/users => generated 284 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.829056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.836046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb6f0d-2759-49b0-8072-6a33f7501344 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.843607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.844694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.845415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.845891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.859169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87829e6-a042-4387-afa5-4a9b00949ddc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.866005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.869313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.872035 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.874246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.875918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.876973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.878688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.883708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.892667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 622/1265] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:59:54.894229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.921734 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1bcff-0025-4777-aff8-37518dd2b0e5 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:54.931286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:54.932017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:54.932295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:54.932673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:54.933192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:54.937106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:54.952996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 644/1266] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.955048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:54.969608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 623/1267] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:54 2022] POST /identity/v3/users => generated 292 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:54.970621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.001070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252908-7d90-4214-9e5e-4463ab462a7d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.100450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:55.111124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329459e-1a98-4c78-812b-1218f2bf0be7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.124006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.125230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.126340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.126929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.128413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.132597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.151711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.154338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.156059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.156730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] PATH_INFO: `/v3/projects/26edb4523978426a960ed3b71524aafd/users/5e7e0656979a46a7ad19353199e91a88/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.159138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 645/1268] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.160300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.180844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26edb4523978426a960ed3b71524aafd, user_id=5e7e0656979a46a7ad19353199e91a88, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.184567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.186281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735138-4853-4ae5-81a0-21b77acd3ed6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.200658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.202112 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.202885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.203509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.205400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.210122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.215712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 624/1269] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:54 2022] PUT /identity/v3/projects/26edb4523978426a960ed3b71524aafd/users/5e7e0656979a46a7ad19353199e91a88/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:55.216994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.239826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 646/1270] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.241744 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.271907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df7920-3f99-4483-8c86-fefd758866d8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.309841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502487b-15ed-48b6-a217-7a5fa465a95d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.316976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.318052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.318332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.318700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.319465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.321906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.343310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 625/1271] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.343310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.369858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9945f-c1a4-4db8-99de-27fd04e64231 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.379332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.379645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.380062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.380580 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.382016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.388882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.437611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 626/1272] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.438412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.445971 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0b10a-44e4-4e02-8820-c5dae04d3b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.447297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0b10a-44e4-4e02-8820-c5dae04d3b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.448257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0b10a-44e4-4e02-8820-c5dae04d3b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.449453 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0b10a-44e4-4e02-8820-c5dae04d3b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.451755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0b10a-44e4-4e02-8820-c5dae04d3b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.455968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0b10a-44e4-4e02-8820-c5dae04d3b3b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.458143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6446456-2886-48c5-b6fa-52929b179baf admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.472964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.474107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.474599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.475032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.476234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.479532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.512168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 647/1273] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:55 2022] POST /identity/v3/users => generated 296 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:55.513891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0b60f-708e-4258-94dc-b1d21b573594 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.515780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0b60f-708e-4258-94dc-b1d21b573594 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.516764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0b60f-708e-4258-94dc-b1d21b573594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.519593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 627/1274] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.522415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.546645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e83459-17ed-45f2-ae22-df3d549cba5f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.556886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.557944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.558871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.558871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.559939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.563111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.586295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-97b0b60f-708e-4258-94dc-b1d21b573594 None None] MFA Rules not processed for user `5e7e0656979a46a7ad19353199e91a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:55.589066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-97b0b60f-708e-4258-94dc-b1d21b573594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:55.599375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 628/1275] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.599375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.617328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:55.622702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f97e6-e34e-412c-8331-02ef9a007fd1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.634286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.635885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.637443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.638345 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.639860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.644386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.678760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 629/1276] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.681061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.706504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c728a9-a6fb-4912-966d-67f2efcb4935 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.717333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.718658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.719255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.719743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.725312 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.730310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.746437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 648/1277] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:55.750463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0b60f-708e-4258-94dc-b1d21b573594 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.762034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 630/1278] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.765489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.777877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0b60f-708e-4258-94dc-b1d21b573594 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.795809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bba9f6-deaa-432c-82ae-2d4938780a5c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.796992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.798247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.799040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.799673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.801419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.805670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.805983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.807266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.807764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.808393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] PATH_INFO: `/v3/projects/df3bcc1c0616492491f5029b13faafa3/users/89f04c92184043c3a6cd7249340519dd/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.835015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 649/1279] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:55.836155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.860703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22067a02-6372-488a-9113-ca9bb8126292 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:55.865572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3bcc1c0616492491f5029b13faafa3, user_id=89f04c92184043c3a6cd7249340519dd, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.868330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:55.869102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:55.869478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:55.869869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] PATH_INFO: `/v3/projects/78405cdbebad4931a9e471e5b4728cb9/users/c3dd26a68dd14618bd8d26f5acc7ed0b/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:55.876840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.899704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78405cdbebad4931a9e471e5b4728cb9, user_id=c3dd26a68dd14618bd8d26f5acc7ed0b, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:55.903547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:55.906605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 631/1280] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:55 2022] PUT /identity/v3/projects/df3bcc1c0616492491f5029b13faafa3/users/89f04c92184043c3a6cd7249340519dd/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:55.907645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.925581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 650/1281] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:55 2022] PUT /identity/v3/projects/78405cdbebad4931a9e471e5b4728cb9/users/c3dd26a68dd14618bd8d26f5acc7ed0b/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:55.931334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:55.994253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:56.026159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32289cdb-8261-42ef-97ec-199a71ffbbcc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:56.061755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ca0f6-573c-429f-9565-4bc758d56d05 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:56.071146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:56.072268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.072727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.073155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.074313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:56.079210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:56.183792 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:56.183792 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.183792 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.225118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 651/1282] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:55 2022] POST /identity/v3/projects => generated 363 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:56.226677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] PATH_INFO: `/v3/projects/e860ee6b43cb4f7bb20c9fb127588b28/users/c10de20457ed48029718d735f2aa7caa/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.227733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:56.227879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e860ee6b43cb4f7bb20c9fb127588b28, user_id=c10de20457ed48029718d735f2aa7caa, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:56.229803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:56.297471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 632/1283] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:55 2022] PUT /identity/v3/projects/e860ee6b43cb4f7bb20c9fb127588b28/users/c10de20457ed48029718d735f2aa7caa/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:56.298531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:56.336871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d3e3-f8ba-4b66-921c-9299b1e798b7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:56.371837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:56.568450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cad81-8f33-4374-b588-f22776cd1734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:56.569423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26638a-83e6-4f95-952d-073c449fce87 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:56.571565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cad81-8f33-4374-b588-f22776cd1734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.572057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cad81-8f33-4374-b588-f22776cd1734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.572522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cad81-8f33-4374-b588-f22776cd1734 admin admin] PATH_INFO: `/v3/projects/781205dc68784d2abc0ee71cb8a957d3/users/1d0e6b5602414b3882e751f091cd6ce7/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.580360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab589bf4-923c-4c59-8251-be458c38a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:56.582006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589bf4-923c-4c59-8251-be458c38a909 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.582832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589bf4-923c-4c59-8251-be458c38a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.583805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab589bf4-923c-4c59-8251-be458c38a909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.585492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab589bf4-923c-4c59-8251-be458c38a909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:56.589373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab589bf4-923c-4c59-8251-be458c38a909 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:56.624620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cad81-8f33-4374-b588-f22776cd1734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781205dc68784d2abc0ee71cb8a957d3, user_id=1d0e6b5602414b3882e751f091cd6ce7, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:56.625813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 633/1284] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:56.627139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abc2ee-ea05-4186-b46a-b3bf2ed45743 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.627437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abc2ee-ea05-4186-b46a-b3bf2ed45743 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.627715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abc2ee-ea05-4186-b46a-b3bf2ed45743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.630427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cad81-8f33-4374-b588-f22776cd1734 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:56.663502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-09abc2ee-ea05-4186-b46a-b3bf2ed45743 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:56.663502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-09abc2ee-ea05-4186-b46a-b3bf2ed45743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:56.669463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 652/1285] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:56 2022] PUT /identity/v3/projects/781205dc68784d2abc0ee71cb8a957d3/users/1d0e6b5602414b3882e751f091cd6ce7/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:56.672089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b65000-8787-4e69-9f25-d89d4dd4c286 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.672582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b65000-8787-4e69-9f25-d89d4dd4c286 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.673069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b65000-8787-4e69-9f25-d89d4dd4c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.736464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-24b65000-8787-4e69-9f25-d89d4dd4c286 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:56.738546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-24b65000-8787-4e69-9f25-d89d4dd4c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:56.799133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 634/1286] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:56.800398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abc2ee-ea05-4186-b46a-b3bf2ed45743 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:56.809169 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:56.816070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abc2ee-ea05-4186-b46a-b3bf2ed45743 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:56.828227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd09521-b964-4b2f-9865-bcc8f5bc5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:56.828938 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd09521-b964-4b2f-9865-bcc8f5bc5a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.829308 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd09521-b964-4b2f-9865-bcc8f5bc5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.829685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd09521-b964-4b2f-9865-bcc8f5bc5a99 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.830730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd09521-b964-4b2f-9865-bcc8f5bc5a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:56.833117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd09521-b964-4b2f-9865-bcc8f5bc5a99 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:56.875178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 635/1287] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:56 2022] POST /identity/v3/users => generated 288 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:56.877655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68fab-fa54-4f67-bc04-c1330f1f3c85 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:56.878057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68fab-fa54-4f67-bc04-c1330f1f3c85 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:56.878420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d68fab-fa54-4f67-bc04-c1330f1f3c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:56.928185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-66d68fab-fa54-4f67-bc04-c1330f1f3c85 None None] MFA Rules not processed for user `c10de20457ed48029718d735f2aa7caa`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:56.930472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-66d68fab-fa54-4f67-bc04-c1330f1f3c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:57.009379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 653/1288] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:57.018131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b65000-8787-4e69-9f25-d89d4dd4c286 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:57.058501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b65000-8787-4e69-9f25-d89d4dd4c286 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:57.080453 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:57.084045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.084580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.085856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] PATH_INFO: `/v3/projects/0193d6c100f44567935ba9af77212fb1/users/6c5db537b1ad455395e4c9a931036c65/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.153838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0193d6c100f44567935ba9af77212fb1, user_id=6c5db537b1ad455395e4c9a931036c65, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:57.164533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 636/1289] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:57.172493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:57.183489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a75c09-5a7b-4232-a6c9-a59c823f7986 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.184276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a75c09-5a7b-4232-a6c9-a59c823f7986 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.185257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a75c09-5a7b-4232-a6c9-a59c823f7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.238883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 654/1290] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:57 2022] PUT /identity/v3/projects/0193d6c100f44567935ba9af77212fb1/users/6c5db537b1ad455395e4c9a931036c65/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:57.248106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:57.293234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-42a75c09-5a7b-4232-a6c9-a59c823f7986 None None] MFA Rules not processed for user `1d0e6b5602414b3882e751f091cd6ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:57.294919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-42a75c09-5a7b-4232-a6c9-a59c823f7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:57.463218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df270d-abb3-492f-914a-c24a5b553fad admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:57.471753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:57.472517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.474164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.474164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.523311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:57.573440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 637/1291] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:57.574467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a75c09-5a7b-4232-a6c9-a59c823f7986 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:57.589690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:57.591870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:57.618320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 655/1292] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:59:57.619287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:57.631778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5222b6-b55f-4e8e-b376-71c5d1c8b375 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:57.641052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:57.642835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.643638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.644625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.647927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a75c09-5a7b-4232-a6c9-a59c823f7986 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:57.660837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817a01-8752-4e32-a206-134440ba5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:57.661494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817a01-8752-4e32-a206-134440ba5766 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.666019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817a01-8752-4e32-a206-134440ba5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.666373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817a01-8752-4e32-a206-134440ba5766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.669139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817a01-8752-4e32-a206-134440ba5766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:57.670916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817a01-8752-4e32-a206-134440ba5766 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:57.671538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:57.673355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:57.685923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 656/1293] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:59:57.687456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:57.699362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bcd6f-15d2-4425-8bdd-fc2e5d1d3cae service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:57.704938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e86b-a4b0-497e-b24f-c800017e150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:57.705781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e86b-a4b0-497e-b24f-c800017e150c admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.706173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e86b-a4b0-497e-b24f-c800017e150c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.706530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e86b-a4b0-497e-b24f-c800017e150c admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.707819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e86b-a4b0-497e-b24f-c800017e150c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:57.710331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e86b-a4b0-497e-b24f-c800017e150c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:57.716186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 638/1294] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:57.717899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5a7d-abc8-4ed0-b59d-48c13dfde9bf None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.718227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5a7d-abc8-4ed0-b59d-48c13dfde9bf None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.718499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f5a7d-abc8-4ed0-b59d-48c13dfde9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.773984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 657/1295] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 11:59:57 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:57.777938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2a23-bc9f-4353-8522-92280cbf12b8 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:57.778888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2a23-bc9f-4353-8522-92280cbf12b8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:57.779267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2a23-bc9f-4353-8522-92280cbf12b8 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:57.784770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b72f5a7d-abc8-4ed0-b59d-48c13dfde9bf None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:57.785492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 658/1296] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 11 11:59:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:59:57.786755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd2a23-bc9f-4353-8522-92280cbf12b8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:57.788432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b72f5a7d-abc8-4ed0-b59d-48c13dfde9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:57.934626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:57.977380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 639/1297] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:57.977380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5a7d-abc8-4ed0-b59d-48c13dfde9bf None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:58.008162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd2a23-bc9f-4353-8522-92280cbf12b8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:58.016882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f5a7d-abc8-4ed0-b59d-48c13dfde9bf None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:58.021367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564ca8-5216-429b-aac9-cb09b1951fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:58.024061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564ca8-5216-429b-aac9-cb09b1951fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.025504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564ca8-5216-429b-aac9-cb09b1951fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.026484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564ca8-5216-429b-aac9-cb09b1951fb2 admin admin] PATH_INFO: `/v3/projects/80ee456cffb04c32ba70eebc0abede88/users/5dfb0de2aac34d559098006272303058/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.038159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:58.039670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.042809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.044110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.046029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:58.055813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:58.064291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564ca8-5216-429b-aac9-cb09b1951fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ee456cffb04c32ba70eebc0abede88, user_id=5dfb0de2aac34d559098006272303058, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:58.070603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564ca8-5216-429b-aac9-cb09b1951fb2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:58.110394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 659/1298] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:57 2022] PUT /identity/v3/projects/80ee456cffb04c32ba70eebc0abede88/users/5dfb0de2aac34d559098006272303058/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:58.115772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e984-f938-4dd2-887c-0e692de4a1d6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.117172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e984-f938-4dd2-887c-0e692de4a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.117652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62e984-f938-4dd2-887c-0e692de4a1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.132798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 640/1299] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 11:59:57 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 11:59:58.140872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:58.212277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bc62e984-f938-4dd2-887c-0e692de4a1d6 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:58.213776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bc62e984-f938-4dd2-887c-0e692de4a1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:58.330233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e6211-e62f-403f-94aa-992fff4501ee admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:58.354674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:58.412205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 660/1300] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 11 11:59:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:58.413889 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e984-f938-4dd2-887c-0e692de4a1d6 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:58.477023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:58.478141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.478671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.479116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.541209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62e984-f938-4dd2-887c-0e692de4a1d6 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:58.555445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:58.556546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.557002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.558055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.559011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:58.561279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:58.610872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 661/1301] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:58.612457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:58.660861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137723e-b693-49f2-9d89-51849508cc2f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:58.671030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:58.672238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.672693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.673117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.674803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:58.677816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:58.695432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:58.700412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:58.709876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 662/1302] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:58.711261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:58.718976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 641/1303] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:59:58.720218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:58.735688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08b7f7-fbd7-4c22-8fc8-b0f4f6b71608 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:58.738093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6aa4e-7ef8-407c-a403-844700f8ecea admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:58.746471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:58.747524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.747951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.748459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] PATH_INFO: `/v3/projects/80ee456cffb04c32ba70eebc0abede88/users/5dfb0de2aac34d559098006272303058/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.752074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ee456cffb04c32ba70eebc0abede88, user_id=5dfb0de2aac34d559098006272303058, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:58.754804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3ba16-01de-40cb-8339-7f6c1d4c32d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:58.755683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3ba16-01de-40cb-8339-7f6c1d4c32d9 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:58.756001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3ba16-01de-40cb-8339-7f6c1d4c32d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:58.756359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3ba16-01de-40cb-8339-7f6c1d4c32d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:58.757900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:58.794899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 642/1304] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:58 2022] PUT /identity/v3/projects/80ee456cffb04c32ba70eebc0abede88/users/5dfb0de2aac34d559098006272303058/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:58.796525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:58.943869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:59.016303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3ba16-01de-40cb-8339-7f6c1d4c32d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:59.019511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3ba16-01de-40cb-8339-7f6c1d4c32d9 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:59.022376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93001d2-ce92-4b91-8a4e-3149a55ddaf7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:59.032943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:59.034093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.034606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.035216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] PATH_INFO: `/v3/projects/7bf0b239d68a4dfe9399c06cbcf9c6c2/users/2799386b7f604900aa9220f4d23c2899/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.062177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 663/1305] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:59:59.064096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c2bb-b37b-47f9-aa1c-7c1b55883462 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.064651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c2bb-b37b-47f9-aa1c-7c1b55883462 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.065306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c2bb-b37b-47f9-aa1c-7c1b55883462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.081014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf0b239d68a4dfe9399c06cbcf9c6c2, user_id=2799386b7f604900aa9220f4d23c2899, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:59.096942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:59.171561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 643/1306] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:58 2022] PUT /identity/v3/projects/7bf0b239d68a4dfe9399c06cbcf9c6c2/users/2799386b7f604900aa9220f4d23c2899/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:59.179601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:59.222582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-21b7c2bb-b37b-47f9-aa1c-7c1b55883462 None None] MFA Rules not processed for user `5dfb0de2aac34d559098006272303058`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:59.228812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-21b7c2bb-b37b-47f9-aa1c-7c1b55883462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:59.378242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:59.406018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 664/1307] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:59.432688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c2bb-b37b-47f9-aa1c-7c1b55883462 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:59.439689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8a34-c9b4-4a0b-829a-3a23158d87e2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:59.457804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6f71-798b-42e5-89ac-19f084a4bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:59.458845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6f71-798b-42e5-89ac-19f084a4bc9a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.459306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6f71-798b-42e5-89ac-19f084a4bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.459757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6f71-798b-42e5-89ac-19f084a4bc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.460895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6f71-798b-42e5-89ac-19f084a4bc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:59.463907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6f71-798b-42e5-89ac-19f084a4bc9a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:59.517601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 644/1308] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 11:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 11:59:59.521124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7db345-777c-4b0d-9c0a-70fdb3617b07 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.521920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7db345-777c-4b0d-9c0a-70fdb3617b07 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.522641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7db345-777c-4b0d-9c0a-70fdb3617b07 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.533550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 645/1309] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 11 11:59:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 11:59:59.535433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7db345-777c-4b0d-9c0a-70fdb3617b07 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:59.544365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c2bb-b37b-47f9-aa1c-7c1b55883462 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:59.556614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995cdd5-e8fd-4470-880d-99d22720b3f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:59.557937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995cdd5-e8fd-4470-880d-99d22720b3f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.557937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995cdd5-e8fd-4470-880d-99d22720b3f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.558946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995cdd5-e8fd-4470-880d-99d22720b3f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.573889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7db345-777c-4b0d-9c0a-70fdb3617b07 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 11:59:59.587242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809503-9823-4203-bad3-1f2ce478f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 11:59:59.587756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995cdd5-e8fd-4470-880d-99d22720b3f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:59.588658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809503-9823-4203-bad3-1f2ce478f001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.591215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995cdd5-e8fd-4470-880d-99d22720b3f6 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:59.591479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809503-9823-4203-bad3-1f2ce478f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.591664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809503-9823-4203-bad3-1f2ce478f001 admin admin] PATH_INFO: `/v3/projects/7bf0b239d68a4dfe9399c06cbcf9c6c2/users/2799386b7f604900aa9220f4d23c2899/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.598523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809503-9823-4203-bad3-1f2ce478f001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf0b239d68a4dfe9399c06cbcf9c6c2, user_id=2799386b7f604900aa9220f4d23c2899, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 11:59:59.603625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809503-9823-4203-bad3-1f2ce478f001 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 11:59:59.634248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 665/1310] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 11:59:59.637892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33ef2-0366-4f98-8018-3e60b364e49b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.639777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33ef2-0366-4f98-8018-3e60b364e49b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.641269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33ef2-0366-4f98-8018-3e60b364e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.654310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 646/1311] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 11:59:59 2022] PUT /identity/v3/projects/7bf0b239d68a4dfe9399c06cbcf9c6c2/users/2799386b7f604900aa9220f4d23c2899/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 11:59:59.665355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11d55b-27f6-48b9-b2dc-6ca6bbe5f2ce None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 11:59:59.665990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11d55b-27f6-48b9-b2dc-6ca6bbe5f2ce None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 11:59:59.666456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11d55b-27f6-48b9-b2dc-6ca6bbe5f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 11:59:59.694933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8dc33ef2-0366-4f98-8018-3e60b364e49b None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:59.697375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8dc33ef2-0366-4f98-8018-3e60b364e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:59.741813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5f11d55b-27f6-48b9-b2dc-6ca6bbe5f2ce None None] MFA Rules not processed for user `2799386b7f604900aa9220f4d23c2899`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 11:59:59.744151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5f11d55b-27f6-48b9-b2dc-6ca6bbe5f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 11:59:59.901135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 666/1312] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 11:59:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 11:59:59.925445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33ef2-0366-4f98-8018-3e60b364e49b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 11:59:59.993661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 647/1313] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 11:59:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:00.084433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33ef2-0366-4f98-8018-3e60b364e49b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:00.094864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:00.098650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:00.099571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:00.100633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:00.142809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11d55b-27f6-48b9-b2dc-6ca6bbe5f2ce None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:00.160691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:00.165757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11d55b-27f6-48b9-b2dc-6ca6bbe5f2ce None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:00.170962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:00.172918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255f7fa-7556-4869-a430-37c1ee7e91fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:00.174325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255f7fa-7556-4869-a430-37c1ee7e91fa service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:00.175205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255f7fa-7556-4869-a430-37c1ee7e91fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:00.175981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255f7fa-7556-4869-a430-37c1ee7e91fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:00.197423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255f7fa-7556-4869-a430-37c1ee7e91fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:00.200474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255f7fa-7556-4869-a430-37c1ee7e91fa service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:00.239637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 648/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:00.241710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 667/1315] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 11:59:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:00:02.482601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:02.551981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:02.646711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099255b-1068-4f5c-81d5-694020ff3393 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:02.654522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:02.655665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:02.666522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:02.666522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] PATH_INFO: `/v3/users/5e7e0656979a46a7ad19353199e91a88` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:02.672270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7e0656979a46a7ad19353199e91a88)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:02.673778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: WARNING py.warnings [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 12:00:02.673778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: warnings.warn(msg) Oct 11 12:00:02.673778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: Oct 11 12:00:02.675660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:02.703455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678c67-4b33-4737-9f5c-52c09de1ead6 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:02.704411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678c67-4b33-4737-9f5c-52c09de1ead6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:02.705199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51678c67-4b33-4737-9f5c-52c09de1ead6 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:02.707721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 649/1316] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 11 12:00:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:00:02.715575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6143593-571d-4d21-a572-922caea27163 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:02.716889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6143593-571d-4d21-a572-922caea27163 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:02.717543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6143593-571d-4d21-a572-922caea27163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:02.762996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a6143593-571d-4d21-a572-922caea27163 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:02.766905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a6143593-571d-4d21-a572-922caea27163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:02.794471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 650/1317] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 11 12:00:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:02.803016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b101a7-03c7-412b-896d-9dfa71b689e3 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:02.804852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b101a7-03c7-412b-896d-9dfa71b689e3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:02.805612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b101a7-03c7-412b-896d-9dfa71b689e3 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:02.812411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 651/1318] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 11 12:00:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 12:00:02.818426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ab4c-569e-4d44-85bc-40b30426a267 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:02.819229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ab4c-569e-4d44-85bc-40b30426a267 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:02.820785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ab4c-569e-4d44-85bc-40b30426a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:02.841103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:02.845783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7e0656979a46a7ad19353199e91a88'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:02.849838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7e0656979a46a7ad19353199e91a88'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:02.875309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6c48ab4c-569e-4d44-85bc-40b30426a267 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:02.879325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6c48ab4c-569e-4d44-85bc-40b30426a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:02.883906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7e0656979a46a7ad19353199e91a88'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:02.927662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7e0656979a46a7ad19353199e91a88'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:02.936928 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 652/1319] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:00:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:02.952813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ab4c-569e-4d44-85bc-40b30426a267 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:02.971064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48ab4c-569e-4d44-85bc-40b30426a267 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:02.989490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:02.990630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:02.991156 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:02.991608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:03.011830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6cd7a8a3-323f-4736-ac29-5f09a2a62ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7e0656979a46a7ad19353199e91a88'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:03.030619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 668/1320] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:02 2022] DELETE /identity/v3/users/5e7e0656979a46a7ad19353199e91a88 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:03.036230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:03.039903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:03.040339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:03.040759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:03.048255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:03.079341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 653/1321] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:00:03.120996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:03.128380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:03.364205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 669/1322] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:03.551302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:03.740276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60999383-f098-4bee-8c4a-48d879b6505d service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:03.847731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689119a-9819-4428-baee-af69a35f8c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:03.848546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689119a-9819-4428-baee-af69a35f8c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:03.849284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689119a-9819-4428-baee-af69a35f8c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:03.849677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689119a-9819-4428-baee-af69a35f8c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:03.892046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689119a-9819-4428-baee-af69a35f8c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:03.893562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689119a-9819-4428-baee-af69a35f8c38 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:03.913009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 654/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:05.361006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:05.364329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:05.398897 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43779ca0-0e43-4187-95d4-7ce0b1a6a08c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:05.409621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:05.412557 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:05.413177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:05.413725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] PATH_INFO: `/v3/users/c10de20457ed48029718d735f2aa7caa` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:05.418463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10de20457ed48029718d735f2aa7caa)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:05.424644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:05.586394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10de20457ed48029718d735f2aa7caa'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:05.587903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10de20457ed48029718d735f2aa7caa'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:05.592146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:05.614642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10de20457ed48029718d735f2aa7caa'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:05.640156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10de20457ed48029718d735f2aa7caa'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:05.695524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10de20457ed48029718d735f2aa7caa'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:05.735919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 670/1324] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:05 2022] DELETE /identity/v3/users/c10de20457ed48029718d735f2aa7caa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:05.738247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:05.739252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:05.739751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:05.772560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:05.774884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:06.054236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 655/1325] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:06.330197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:06.332299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:06.507857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3da0e-0650-4e0d-9b40-804d80a2cd43 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:06.513523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:06.515770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:06.517292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:06.518238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:06.518516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:06.518836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:06.533360 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:06.537259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:06.540765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f41985-8f05-4c07-9ff3-67c0ddfad7ba None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:06.559168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 671/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:00:06.559447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:06.560089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:06.560414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:06.560678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] PATH_INFO: `/v3/projects/26edb4523978426a960ed3b71524aafd` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:06.567838 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26edb4523978426a960ed3b71524aafd)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:06.568572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: WARNING py.warnings [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 11 12:00:06.568572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: warnings.warn(msg) Oct 11 12:00:06.568572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: Oct 11 12:00:06.574597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:06.688745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:06.724580 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26edb4523978426a960ed3b71524aafd', 'request_id': 'req-cd23d464-6226-4e90-a609-6351e8366e8a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:06.747259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26edb4523978426a960ed3b71524aafd', 'request_id': 'req-cd23d464-6226-4e90-a609-6351e8366e8a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:06.766433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26edb4523978426a960ed3b71524aafd', 'request_id': 'req-cd23d464-6226-4e90-a609-6351e8366e8a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:06.841588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] The token cache is being invalidate because project 26edb4523978426a960ed3b71524aafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:06.842016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:06.842976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:06.848293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 656/1327] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:06 2022] DELETE /identity/v3/projects/26edb4523978426a960ed3b71524aafd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:06.849553 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:06.869186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdb21-afc6-486f-a0b8-c6bc21b69d98 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:07.009727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:07.010415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:07.010777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:07.011046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] PATH_INFO: `/v3/users/5dfb0de2aac34d559098006272303058` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:07.012404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfb0de2aac34d559098006272303058)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:07.018735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:07.115260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfb0de2aac34d559098006272303058'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.116455 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfb0de2aac34d559098006272303058'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.131422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfb0de2aac34d559098006272303058'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.145249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfb0de2aac34d559098006272303058'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.157519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:07.189168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87eff2a6-3b93-4b2b-a4b3-015db9ef0f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfb0de2aac34d559098006272303058'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.202050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 672/1328] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:06 2022] DELETE /identity/v3/users/5dfb0de2aac34d559098006272303058 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:07.713259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:07.715341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:07.732094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d464-6226-4e90-a609-6351e8366e8a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:07.827380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:07.829038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:07.829556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:07.830088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] PATH_INFO: `/v3/users/1d0e6b5602414b3882e751f091cd6ce7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:07.836239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0e6b5602414b3882e751f091cd6ce7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:07.838375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:07.922405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0e6b5602414b3882e751f091cd6ce7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.923423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0e6b5602414b3882e751f091cd6ce7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.940171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0e6b5602414b3882e751f091cd6ce7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.953532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0e6b5602414b3882e751f091cd6ce7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.954714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0e6b5602414b3882e751f091cd6ce7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:07.987183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 657/1329] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:07 2022] DELETE /identity/v3/users/1d0e6b5602414b3882e751f091cd6ce7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:07.992256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:07.992763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:07.992857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:08.026733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:08.028044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:08.150457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 673/1330] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:08.189785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:08.192892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:08.318622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:08.350974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799a81a-84ed-4770-b807-a94cdb3b2b9d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:08.358477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:08.360209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:08.360629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:08.360943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:08.393987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:08.397055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:08.429674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 658/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:08.906845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:08.909164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:08.965102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cc06-ed0c-4aba-bf3e-fc18ec3bf946 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:09.001427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:09.004840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:09.006681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:09.009754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] PATH_INFO: `/v3/projects/80ee456cffb04c32ba70eebc0abede88` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:09.024625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ee456cffb04c32ba70eebc0abede88)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:09.034180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:09.070146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:09.075490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:09.121411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8840-5ba1-43f7-99e0-3886e06c4d32 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:09.137231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:09.139388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:09.139388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:09.139388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] PATH_INFO: `/v3/projects/e860ee6b43cb4f7bb20c9fb127588b28` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:09.152250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e860ee6b43cb4f7bb20c9fb127588b28)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:09.158073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:09.211275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ee456cffb04c32ba70eebc0abede88', 'request_id': 'req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.226390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ee456cffb04c32ba70eebc0abede88', 'request_id': 'req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.267392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ee456cffb04c32ba70eebc0abede88', 'request_id': 'req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.296503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] The token cache is being invalidate because project 80ee456cffb04c32ba70eebc0abede88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:09.296835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.297472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0437bfe-38d5-44e7-b1c3-d4e720707eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.299705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 674/1332] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:08 2022] DELETE /identity/v3/projects/80ee456cffb04c32ba70eebc0abede88 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:09.306589 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a4230-5fa7-4d03-9d70-b7154dcc7928 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:09.306902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a4230-5fa7-4d03-9d70-b7154dcc7928 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:09.307201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a4230-5fa7-4d03-9d70-b7154dcc7928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:09.351836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e860ee6b43cb4f7bb20c9fb127588b28', 'request_id': 'req-8a02520a-9c70-4443-bc00-8ea81f8361f6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.355220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-678a4230-5fa7-4d03-9d70-b7154dcc7928 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:09.356611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-678a4230-5fa7-4d03-9d70-b7154dcc7928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:09.369289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e860ee6b43cb4f7bb20c9fb127588b28', 'request_id': 'req-8a02520a-9c70-4443-bc00-8ea81f8361f6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.398716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e860ee6b43cb4f7bb20c9fb127588b28', 'request_id': 'req-8a02520a-9c70-4443-bc00-8ea81f8361f6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.443583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] The token cache is being invalidate because project e860ee6b43cb4f7bb20c9fb127588b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:09.444089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.455943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.459114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 659/1333] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:09 2022] DELETE /identity/v3/projects/e860ee6b43cb4f7bb20c9fb127588b28 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:09.463860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:09.466466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:09.556539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 675/1334] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:09.570486 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8818b-01f3-49c9-9194-5827dc28fdc8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:09.570807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8818b-01f3-49c9-9194-5827dc28fdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:09.571109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8818b-01f3-49c9-9194-5827dc28fdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:09.634930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f3d8818b-01f3-49c9-9194-5827dc28fdc8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:09.638279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f3d8818b-01f3-49c9-9194-5827dc28fdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:09.659189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 676/1335] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:09.660773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8818b-01f3-49c9-9194-5827dc28fdc8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:09.672914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:09.678000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8818b-01f3-49c9-9194-5827dc28fdc8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:09.695677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:09.696650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:09.697385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:09.697827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:09.698717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:09.703570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02520a-9c70-4443-bc00-8ea81f8361f6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:09.704268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:09.706979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:09.716937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:09.717645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:09.717954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:09.718223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] PATH_INFO: `/v3/users/2799386b7f604900aa9220f4d23c2899` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:09.719891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2799386b7f604900aa9220f4d23c2899)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:09.727401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:09.743500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 677/1336] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:00:09.754505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:09.769330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f67482-836f-44d7-b0dc-9392d6702c8e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:09.786331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:09.790065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:09.790754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:09.791078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:09.791790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:09.794580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:09.893400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2799386b7f604900aa9220f4d23c2899'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.898160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 678/1337] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:09 2022] POST /identity/v3/projects => generated 357 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:09.900009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2799386b7f604900aa9220f4d23c2899'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.900497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:09.923274 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2799386b7f604900aa9220f4d23c2899'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.933734 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:09.937687 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2799386b7f604900aa9220f4d23c2899'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:09.938539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2799386b7f604900aa9220f4d23c2899'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:10.069992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 660/1338] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:09 2022] DELETE /identity/v3/users/2799386b7f604900aa9220f4d23c2899 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:10.165326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d8c16-d559-484c-9567-cf2e68cd0a96 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:10.336659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:10.337548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:10.339426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:10.339891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:10.342711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:10.350087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:10.417159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 679/1339] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:09 2022] POST /identity/v3/users => generated 279 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:10.422320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:10.426668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:10.467159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eacfc7-c214-4820-a987-50e54c51b248 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:10.498145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:10.499803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:10.501001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:10.504016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:10.506695 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:10.510266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:10.540459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 661/1340] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:10.545421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:10.585699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d035e-4aba-4a09-88ea-bc5635e41827 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:10.616325 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d4a5-89d4-4e2a-a898-3ea3937c5ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:10.617045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d4a5-89d4-4e2a-a898-3ea3937c5ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:10.617331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d4a5-89d4-4e2a-a898-3ea3937c5ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:10.617892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d4a5-89d4-4e2a-a898-3ea3937c5ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:10.618633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d4a5-89d4-4e2a-a898-3ea3937c5ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:10.620417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d4a5-89d4-4e2a-a898-3ea3937c5ff5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:10.651322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 680/1341] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:00:10.660621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:10.749601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c78df-6299-4268-bddf-30b7ea8a85a9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:10.783221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:10.784464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:10.784945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:10.808448 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] PATH_INFO: `/v3/projects/e923531030884fce945d5e14940d8ef5/users/23ce0c30547845b38a2d8aa98cae9a81/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:10.931133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e923531030884fce945d5e14940d8ef5, user_id=23ce0c30547845b38a2d8aa98cae9a81, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:10.941644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:10.976769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 662/1342] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:10 2022] PUT /identity/v3/projects/e923531030884fce945d5e14940d8ef5/users/23ce0c30547845b38a2d8aa98cae9a81/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:10.987705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ecf8-37f5-440e-afe9-04e3aac40133 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:10.988285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ecf8-37f5-440e-afe9-04e3aac40133 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:10.988734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ecf8-37f5-440e-afe9-04e3aac40133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:11.079746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b445ecf8-37f5-440e-afe9-04e3aac40133 None None] MFA Rules not processed for user `23ce0c30547845b38a2d8aa98cae9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:11.084768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b445ecf8-37f5-440e-afe9-04e3aac40133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:11.233090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:11.286179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 681/1343] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:11.287868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:11.560219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbfeaa-b721-40c4-8035-243107f285b0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:11.587171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:11.588643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:11.589355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:11.590000 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:11.592618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:11.602181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:11.762312 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 663/1344] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:11 2022] POST /identity/v3/projects => generated 355 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:11.763807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ecf8-37f5-440e-afe9-04e3aac40133 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:11.786739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ecf8-37f5-440e-afe9-04e3aac40133 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:11.980261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:11.982871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:11.983338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:11.983656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:11.985469 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:11.991188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:12.061084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 682/1345] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:11 2022] POST /identity/v3/users => generated 284 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:12.062447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:12.101542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91fee-1697-46c1-a47b-5a0fbbe4232c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:12.141914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:12.144612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:12.160672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:12.161608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:12.171144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:12.174823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:12.253640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 664/1346] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:12.258462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:12.269957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445a02-0766-445f-b917-e6a86a59582f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:12.285892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:12.286635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:12.286923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:12.287178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] PATH_INFO: `/v3/projects/0daacc1f04c34d8a8448e41f985c957c/users/138423a63baa4c1aa3da1b7296e2d4f7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:12.335046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0daacc1f04c34d8a8448e41f985c957c, user_id=138423a63baa4c1aa3da1b7296e2d4f7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:12.341875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:12.379880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:12.380640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 683/1347] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:12 2022] PUT /identity/v3/projects/0daacc1f04c34d8a8448e41f985c957c/users/138423a63baa4c1aa3da1b7296e2d4f7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:12.407656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c536686-ec53-41f5-89b4-bcabbc896faa admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:12.436352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:12.439593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:12.586095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9fd3e-d803-45f0-960b-e29cb23f1e56 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:12.600017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:12.603209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:12.603502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:12.603671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] PATH_INFO: `/v3/projects/781205dc68784d2abc0ee71cb8a957d3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:12.608376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781205dc68784d2abc0ee71cb8a957d3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:12.611914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:12.717417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781205dc68784d2abc0ee71cb8a957d3', 'request_id': 'req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:12.723976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:12.725310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ac79d-27b4-423b-b5de-c2358e11a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:12.727384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac79d-27b4-423b-b5de-c2358e11a60e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:12.731297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac79d-27b4-423b-b5de-c2358e11a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:12.732247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac79d-27b4-423b-b5de-c2358e11a60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:12.733914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ac79d-27b4-423b-b5de-c2358e11a60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:12.736824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781205dc68784d2abc0ee71cb8a957d3', 'request_id': 'req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:12.739822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ac79d-27b4-423b-b5de-c2358e11a60e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:12.761225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781205dc68784d2abc0ee71cb8a957d3', 'request_id': 'req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:12.792823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] The token cache is being invalidate because project 781205dc68784d2abc0ee71cb8a957d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:12.793132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:12.798427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:12.806358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 665/1348] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:12.809239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d147b-6478-4bac-b276-741654e2f23c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:12.812281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 684/1349] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:12 2022] DELETE /identity/v3/projects/781205dc68784d2abc0ee71cb8a957d3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:12.818161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:12.820996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:12.827608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d147b-6478-4bac-b276-741654e2f23c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:12.828035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d147b-6478-4bac-b276-741654e2f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:12.956102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-316d147b-6478-4bac-b276-741654e2f23c None None] MFA Rules not processed for user `62e872a76ae44efb845dc3a62b783492`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:12.959528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-316d147b-6478-4bac-b276-741654e2f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:13.018756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:13.069793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdd5f5-ed4e-4943-a306-256aaa7b3218 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:13.089512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d965670-e2e2-4b3d-9fb8-911ac892750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:13.090266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965670-e2e2-4b3d-9fb8-911ac892750e admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:13.090538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965670-e2e2-4b3d-9fb8-911ac892750e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:13.091015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d965670-e2e2-4b3d-9fb8-911ac892750e admin admin] PATH_INFO: `/v3/projects/0daacc1f04c34d8a8448e41f985c957c/users/138423a63baa4c1aa3da1b7296e2d4f7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:13.093926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d965670-e2e2-4b3d-9fb8-911ac892750e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0daacc1f04c34d8a8448e41f985c957c, user_id=138423a63baa4c1aa3da1b7296e2d4f7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:13.097076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d965670-e2e2-4b3d-9fb8-911ac892750e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:13.142630 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 685/1350] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:12 2022] PUT /identity/v3/projects/0daacc1f04c34d8a8448e41f985c957c/users/138423a63baa4c1aa3da1b7296e2d4f7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:13.144191 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdc5b-a73e-4b41-a0fa-ac0806b5a2fc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:13.144526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdc5b-a73e-4b41-a0fa-ac0806b5a2fc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:13.144683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bdc5b-a73e-4b41-a0fa-ac0806b5a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:13.251140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-009bdc5b-a73e-4b41-a0fa-ac0806b5a2fc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:13.256818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-009bdc5b-a73e-4b41-a0fa-ac0806b5a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:13.301901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 666/1351] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:13.301901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d147b-6478-4bac-b276-741654e2f23c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:13.301901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-316d147b-6478-4bac-b276-741654e2f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:13.332893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d147b-6478-4bac-b276-741654e2f23c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:13.480198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:13.481278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:13.481591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:13.481880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] PATH_INFO: `/v3/projects/7bf0b239d68a4dfe9399c06cbcf9c6c2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:13.485338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf0b239d68a4dfe9399c06cbcf9c6c2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:13.490137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:13.597990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 686/1352] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:13.602638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87bcbc-d868-44d7-9384-cba7c0ee662c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:13.608135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87bcbc-d868-44d7-9384-cba7c0ee662c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:13.609126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87bcbc-d868-44d7-9384-cba7c0ee662c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:13.621844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf0b239d68a4dfe9399c06cbcf9c6c2', 'request_id': 'req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:13.631520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf0b239d68a4dfe9399c06cbcf9c6c2', 'request_id': 'req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:13.649594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf0b239d68a4dfe9399c06cbcf9c6c2', 'request_id': 'req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:13.671288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] The token cache is being invalidate because project 7bf0b239d68a4dfe9399c06cbcf9c6c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:13.671694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:13.676279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:13.678349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 667/1353] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:13 2022] DELETE /identity/v3/projects/7bf0b239d68a4dfe9399c06cbcf9c6c2 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:13.684061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:13.690572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:13.701832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0d87bcbc-d868-44d7-9384-cba7c0ee662c None None] MFA Rules not processed for user `138423a63baa4c1aa3da1b7296e2d4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:13.709479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0d87bcbc-d868-44d7-9384-cba7c0ee662c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:13.835363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:13.890244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:13.907717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 687/1354] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:13.909677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad3217-626b-47dd-bde4-de9f1b70cd11 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:13.912762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbd495-dd35-4a6a-8cfb-fb1bc38aa192 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:13.913277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad3217-626b-47dd-bde4-de9f1b70cd11 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:13.913783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad3217-626b-47dd-bde4-de9f1b70cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:13.957964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:13.958654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:13.958936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:13.959204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:13.966699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:13.978123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2aad3217-626b-47dd-bde4-de9f1b70cd11 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:13.979885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2aad3217-626b-47dd-bde4-de9f1b70cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:14.171878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 688/1355] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:14.173423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7edaf-c2a5-4341-bd18-57e6dd918010 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:14.176040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7edaf-c2a5-4341-bd18-57e6dd918010 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:14.176464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7edaf-c2a5-4341-bd18-57e6dd918010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:14.210635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:14.216250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:14.235174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-86d7edaf-c2a5-4341-bd18-57e6dd918010 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:14.241409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-86d7edaf-c2a5-4341-bd18-57e6dd918010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:14.248037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 668/1356] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:14.248684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:14.253126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:14.291054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 689/1357] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:14.292045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7edaf-c2a5-4341-bd18-57e6dd918010 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:14.324936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7edaf-c2a5-4341-bd18-57e6dd918010 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:14.339053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f07fe-7f55-4067-861a-a322a4e46fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:14.339936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f07fe-7f55-4067-861a-a322a4e46fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:14.340307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f07fe-7f55-4067-861a-a322a4e46fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:14.340694 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f07fe-7f55-4067-861a-a322a4e46fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:14.341517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f07fe-7f55-4067-861a-a322a4e46fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:14.341940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f07fe-7f55-4067-861a-a322a4e46fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:14.346493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f07fe-7f55-4067-861a-a322a4e46fe5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:14.396381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 690/1358] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:00:14.398341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0fd03-edaa-4700-8cb7-eadd0602a4a9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:14.405547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0fd03-edaa-4700-8cb7-eadd0602a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:14.406083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0fd03-edaa-4700-8cb7-eadd0602a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:14.480739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8cc5c-6ff6-49b8-b3a2-40a9da640a12 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:14.483867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d6e0fd03-edaa-4700-8cb7-eadd0602a4a9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:14.500633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:14.501291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:14.501570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:14.501837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:14.502038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d6e0fd03-edaa-4700-8cb7-eadd0602a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:14.532580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 691/1359] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:14.533633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:14.534121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0fd03-edaa-4700-8cb7-eadd0602a4a9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:14.535228 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:14.571367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0fd03-edaa-4700-8cb7-eadd0602a4a9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:14.574337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 669/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:14.575431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:14.599453 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:14.600821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:14.603086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:14.603747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:14.606012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:14.623800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:14.627802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d683f-6ba4-4a45-b2f2-8279bba37c23 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:14.651439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:14.652098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:14.652380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:14.652651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:14.653343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:14.653654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:14.655493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:14.727325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 670/1361] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:00:14.734230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:14.741193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 692/1362] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:14 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:14.750413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:14.787844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a1e72-0f9b-4168-b6bf-84fa8feb28d2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:14.989631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e25b4-6d31-4b00-8a34-439ef68aa525 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:14.997227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:14.999858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.000397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.001046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.002086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.007011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.053366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.053893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.054194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.054362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.055124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.057897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.108246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:15.120307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 693/1363] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:14 2022] POST /identity/v3/users => generated 286 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:15.124909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:15.145364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 671/1364] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:14 2022] POST /identity/v3/projects => generated 377 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:15.147513 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:15.276849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:15.336676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edb669-e2de-49e3-83c9-2f4a541d510d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:15.364739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01c1ef-7f70-4094-85a1-bda661d498b5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:15.382598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.384357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.384576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.384741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.386021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.388129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.439243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 672/1365] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:15.440678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:15.489945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2955d-3c71-4a89-ae55-a07b47db0bef admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:15.506939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.507386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.507739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.508082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.510476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:15.533187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.534221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.534633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.535079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.536627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.548719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.631182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 673/1366] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:15 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:15.644356 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:15.691141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.692808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.707546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0a67-d7dc-4745-b498-cf220aaf92f2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:15.720722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 694/1367] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:15.722901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:15.756364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.757378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.761250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.761720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.762976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.763185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc020f75-51ec-4169-b9e0-9abcd97f880a service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:15.782725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.783799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab066df-cd96-42a6-89a0-3a9e7cf96539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.785504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab066df-cd96-42a6-89a0-3a9e7cf96539 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.786707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab066df-cd96-42a6-89a0-3a9e7cf96539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.787462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab066df-cd96-42a6-89a0-3a9e7cf96539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.794828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab066df-cd96-42a6-89a0-3a9e7cf96539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.797034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab066df-cd96-42a6-89a0-3a9e7cf96539 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.821149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 695/1368] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:15.822867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88461eb-4763-4b46-8d95-08d0850480d4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.827187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88461eb-4763-4b46-8d95-08d0850480d4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.828018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88461eb-4763-4b46-8d95-08d0850480d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.841043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 674/1369] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:15.844224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:15.872005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bb370-04c4-4ad9-ae85-ede292183c1f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:15.879349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.881141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.881976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.882451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.883583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.885976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:15.906343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 675/1370] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:15.907585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:15.920902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa627-3d44-436d-8a73-e6109e218143 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:15.931324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f88461eb-4763-4b46-8d95-08d0850480d4 None None] MFA Rules not processed for user `c3dd26a68dd14618bd8d26f5acc7ed0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:15.932909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f88461eb-4763-4b46-8d95-08d0850480d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:15.945891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:15.947029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:15.947539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:15.947970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] PATH_INFO: `/v3/projects/8a0aa51431044afebd3b2c606cca83de/users/c5e4a8809b0043458f4abb62f8c57f65/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:15.989080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0aa51431044afebd3b2c606cca83de, user_id=c5e4a8809b0043458f4abb62f8c57f65, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:15.993643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:16.037048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 676/1371] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:15 2022] PUT /identity/v3/projects/8a0aa51431044afebd3b2c606cca83de/users/c5e4a8809b0043458f4abb62f8c57f65/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:16.038599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:16.174924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273939-b191-409d-a0ec-11845b5ae1fe admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:16.183835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78b3df-d48e-4951-975d-ea5947552174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:16.185403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b3df-d48e-4951-975d-ea5947552174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:16.185911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b3df-d48e-4951-975d-ea5947552174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:16.186964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78b3df-d48e-4951-975d-ea5947552174 admin admin] PATH_INFO: `/v3/projects/880fe01f8811463db834b3c59d62b96e/users/65420db271604e7ebd3a3527ec820e07/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:16.217391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78b3df-d48e-4951-975d-ea5947552174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=880fe01f8811463db834b3c59d62b96e, user_id=65420db271604e7ebd3a3527ec820e07, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:16.223150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78b3df-d48e-4951-975d-ea5947552174 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:16.236210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 696/1372] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:16.250256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dceeb-7e6f-4229-8dea-e34e13400e35 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:16.252436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 677/1373] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:16 2022] PUT /identity/v3/projects/880fe01f8811463db834b3c59d62b96e/users/65420db271604e7ebd3a3527ec820e07/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:16.253318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dceeb-7e6f-4229-8dea-e34e13400e35 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:16.253783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dceeb-7e6f-4229-8dea-e34e13400e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:16.273974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:16.274733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:16.275251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:16.328712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:16.352273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] MFA Rules not processed for user `65420db271604e7ebd3a3527ec820e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:16.353702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:16.373339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f95dceeb-7e6f-4229-8dea-e34e13400e35 None None] MFA Rules not processed for user `c5e4a8809b0043458f4abb62f8c57f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:16.377779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f95dceeb-7e6f-4229-8dea-e34e13400e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:16.438786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:16.604647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 678/1374] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:16.605996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:16.610886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:16.621678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 697/1375] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:16.627237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee379c-ff8b-4d88-800c-680173e51f71 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:16.627237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee379c-ff8b-4d88-800c-680173e51f71 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:16.627237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee379c-ff8b-4d88-800c-680173e51f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:16.801002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b8ee379c-ff8b-4d88-800c-680173e51f71 None None] MFA Rules not processed for user `d35bcd2d840a4fd4be9c0ac0fff6d6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:16.804978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b8ee379c-ff8b-4d88-800c-680173e51f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:16.831797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8404d-3307-4f24-a779-a39a309553bb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:16.847802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:16.848217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:16.848492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:16.848820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:17.050655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 698/1376] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:17.051764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee379c-ff8b-4d88-800c-680173e51f71 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:17.074519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:17.079043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:17.109188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 679/1377] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:17.110384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:17.151650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da7126-ecab-4e5a-9a54-5e9199f9f594 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:17.170862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d205061-ae3f-455e-824c-eb52c38a0158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:17.171535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d205061-ae3f-455e-824c-eb52c38a0158 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:17.171825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d205061-ae3f-455e-824c-eb52c38a0158 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:17.172100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d205061-ae3f-455e-824c-eb52c38a0158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:17.196196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d205061-ae3f-455e-824c-eb52c38a0158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:17.199140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d205061-ae3f-455e-824c-eb52c38a0158 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:17.221740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee379c-ff8b-4d88-800c-680173e51f71 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:17.226300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 680/1378] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:17.229071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6916b-c9f9-4b85-bad8-024c72cbd220 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:17.229530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6916b-c9f9-4b85-bad8-024c72cbd220 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:17.229885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6916b-c9f9-4b85-bad8-024c72cbd220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:17.248431 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:17.249421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:17.249770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:17.250107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:17.250886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:17.253001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:17.273568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-36e6916b-c9f9-4b85-bad8-024c72cbd220 None None] MFA Rules not processed for user `d35bcd2d840a4fd4be9c0ac0fff6d6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:17.274887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-36e6916b-c9f9-4b85-bad8-024c72cbd220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:17.307639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 681/1379] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:17.330367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 699/1380] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:17 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:17.331743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6916b-c9f9-4b85-bad8-024c72cbd220 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:17.347666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6916b-c9f9-4b85-bad8-024c72cbd220 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:17.382053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:17.511682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:17.514242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:17.514581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:17.515235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:17.517590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:17.522989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:17.575294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 682/1381] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:17 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:00:17.579026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:17.589233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:17.633670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a31971-9676-4151-862b-3076672104a8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:17.654364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:17.655670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:17.656002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:17.656278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:17.662487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:17.667911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:17.726317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 683/1382] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:17.740351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:17.797631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:17.841595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b8af-4914-451e-82e3-915731968883 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:17.867453 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:17.870483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:17.870879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:17.871155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] PATH_INFO: `/v3/projects/126f31f848dc48a59bab720cc4b80256/users/00942f574aaf49d8b50b1ebb960efaca/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:17.922999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=126f31f848dc48a59bab720cc4b80256, user_id=00942f574aaf49d8b50b1ebb960efaca, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:17.931860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:17.989765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 684/1383] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:17 2022] PUT /identity/v3/projects/126f31f848dc48a59bab720cc4b80256/users/00942f574aaf49d8b50b1ebb960efaca/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:17.995294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:17.995604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca012a6-2acd-477c-b279-1e5e0c3a4247 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:18.269858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d473e2-1cf4-4a65-87a8-900fc494d19d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:18.292517 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:18.296148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:18.297983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:18.299705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:18.301957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:18.307993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:18.350070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 685/1384] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:18.372117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:18.416360 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:18.417901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:18.418860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:18.419541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:18.436655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9553a37-dbb9-4115-8c82-b647bad614fa admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:18.467404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77330cc-b582-4372-8e85-1c51431ea63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:18.468990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77330cc-b582-4372-8e85-1c51431ea63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:18.474542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77330cc-b582-4372-8e85-1c51431ea63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:18.475361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77330cc-b582-4372-8e85-1c51431ea63c admin admin] PATH_INFO: `/v3/projects/126f31f848dc48a59bab720cc4b80256/users/00942f574aaf49d8b50b1ebb960efaca/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:18.492821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77330cc-b582-4372-8e85-1c51431ea63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=126f31f848dc48a59bab720cc4b80256, user_id=00942f574aaf49d8b50b1ebb960efaca, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:18.506843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77330cc-b582-4372-8e85-1c51431ea63c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:18.560931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 686/1385] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:18 2022] PUT /identity/v3/projects/126f31f848dc48a59bab720cc4b80256/users/00942f574aaf49d8b50b1ebb960efaca/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:18.573387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5777f-691e-4ca4-af31-cbd2051d3919 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:18.573858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5777f-691e-4ca4-af31-cbd2051d3919 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:18.574538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5777f-691e-4ca4-af31-cbd2051d3919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:18.650174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:18.652530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:18.695047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7cc5777f-691e-4ca4-af31-cbd2051d3919 None None] MFA Rules not processed for user `00942f574aaf49d8b50b1ebb960efaca`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:18.697186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7cc5777f-691e-4ca4-af31-cbd2051d3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:18.726935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 700/1386] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:18.878781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:19.066295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 687/1387] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:19.081567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:19.084340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:19.442036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc70cd2-8715-4ea8-afe0-1c185a39ca43 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:19.556705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:19.625772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132546e5-061e-4dae-87fb-9aab912d329b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:19.626608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132546e5-061e-4dae-87fb-9aab912d329b service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:19.627026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132546e5-061e-4dae-87fb-9aab912d329b service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:19.627423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132546e5-061e-4dae-87fb-9aab912d329b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:19.776763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132546e5-061e-4dae-87fb-9aab912d329b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:19.778772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132546e5-061e-4dae-87fb-9aab912d329b service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:19.803403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 701/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:20.580837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496ad4-cab3-418b-80c8-74138bba3d7f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:20.581768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496ad4-cab3-418b-80c8-74138bba3d7f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:20.582454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496ad4-cab3-418b-80c8-74138bba3d7f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:20.585263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 688/1389] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 11 12:00:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 12:00:20.601247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9b19-9740-43e5-a764-2a312629f340 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:20.601960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9b19-9740-43e5-a764-2a312629f340 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:20.601960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9b19-9740-43e5-a764-2a312629f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:20.756115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bdef9b19-9740-43e5-a764-2a312629f340 None None] MFA Rules not processed for user `985db5d7ded74dbeaa8fae4515fea049`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:20.757737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bdef9b19-9740-43e5-a764-2a312629f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:20.947149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 702/1390] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:21.086942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67496ad4-cab3-418b-80c8-74138bba3d7f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:21.093186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-67496ad4-cab3-418b-80c8-74138bba3d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:21.164514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67496ad4-cab3-418b-80c8-74138bba3d7f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:21.179151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:21.180289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:21.180799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:21.181252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:21.238801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:21.241560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:21.266217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 689/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:22.618289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9b19-9740-43e5-a764-2a312629f340 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:22.634772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9b19-9740-43e5-a764-2a312629f340 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:22.648036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c16e4b-33d2-4158-9f6d-799007bfc63e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:22.649745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16e4b-33d2-4158-9f6d-799007bfc63e service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:22.650878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16e4b-33d2-4158-9f6d-799007bfc63e service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:22.651592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16e4b-33d2-4158-9f6d-799007bfc63e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:22.675899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c16e4b-33d2-4158-9f6d-799007bfc63e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:22.677807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c16e4b-33d2-4158-9f6d-799007bfc63e service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:22.710859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 703/1392] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:23.109830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:23.507857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfcbec-9503-43cd-b183-74c64efbee22 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:23.520771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:23.521477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:23.521751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:23.524472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] PATH_INFO: `/v3/users/c5e4a8809b0043458f4abb62f8c57f65` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:23.527173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e4a8809b0043458f4abb62f8c57f65)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:23.531970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:23.645716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e4a8809b0043458f4abb62f8c57f65'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:23.646577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e4a8809b0043458f4abb62f8c57f65'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:23.683557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e4a8809b0043458f4abb62f8c57f65'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:23.705170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e4a8809b0043458f4abb62f8c57f65'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:23.706000 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e4a8809b0043458f4abb62f8c57f65'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:23.743017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 690/1393] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:23 2022] DELETE /identity/v3/users/c5e4a8809b0043458f4abb62f8c57f65 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:23.749271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:23.750204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:23.750204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:23.800791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:23.802019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:24.067720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:24.071954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:24.087409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 704/1394] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:24.439490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:24.497366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:24.499272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:24.513654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:24.635970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429819f5-1183-4ba2-83e7-b0376a7e2f67 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:24.661397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc4e59-e32a-4bca-b00a-52cb3bbeac82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:24.667573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4e59-e32a-4bca-b00a-52cb3bbeac82 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:24.671602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4e59-e32a-4bca-b00a-52cb3bbeac82 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:24.672071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc4e59-e32a-4bca-b00a-52cb3bbeac82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:24.689265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c8dc4e59-e32a-4bca-b00a-52cb3bbeac82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:24.749739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4e59-e32a-4bca-b00a-52cb3bbeac82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:24.751599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc4e59-e32a-4bca-b00a-52cb3bbeac82 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:24.787218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb39c-2065-41f1-86ae-97f80e9ce50c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:24.805333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 691/1395] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:24.811527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:24.813050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:24.814463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:24.815162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:24.892064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:24.905853 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:24.947314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 705/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:00:25.102699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647d5c9-5e8b-448a-8eed-758372c49702 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:25.103170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647d5c9-5e8b-448a-8eed-758372c49702 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:25.103641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647d5c9-5e8b-448a-8eed-758372c49702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:25.224376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b647d5c9-5e8b-448a-8eed-758372c49702 None None] MFA Rules not processed for user `89f04c92184043c3a6cd7249340519dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:25.226909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b647d5c9-5e8b-448a-8eed-758372c49702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:25.455645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 692/1397] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:25.466116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:25.467957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:25.741495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbad635-1ccb-4866-8836-05231f4e8b76 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:25.749173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559768b-57e7-414e-a15f-77e2e062d958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:25.751027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559768b-57e7-414e-a15f-77e2e062d958 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:25.751578 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559768b-57e7-414e-a15f-77e2e062d958 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:25.752191 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559768b-57e7-414e-a15f-77e2e062d958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:25.776506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559768b-57e7-414e-a15f-77e2e062d958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:25.779467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559768b-57e7-414e-a15f-77e2e062d958 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:25.805142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 706/1398] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:25.865355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:25.865612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:25.865811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:25.988507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] MFA Rules not processed for user `62e872a76ae44efb845dc3a62b783492`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:26.053039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:26.260002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 693/1399] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:27.699903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25418a01-9279-4a3d-ac8f-c04a144c1894 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:27.700522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25418a01-9279-4a3d-ac8f-c04a144c1894 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:27.701917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25418a01-9279-4a3d-ac8f-c04a144c1894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:27.794940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-25418a01-9279-4a3d-ac8f-c04a144c1894 None None] MFA Rules not processed for user `c3dd26a68dd14618bd8d26f5acc7ed0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:27.801763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-25418a01-9279-4a3d-ac8f-c04a144c1894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:27.852059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:27.854872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:27.883205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca943f68-39be-442f-8c63-fc31ee7c6991 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:27.898972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:27.904683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:27.919042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:27.920999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] PATH_INFO: `/v3/users/65420db271604e7ebd3a3527ec820e07` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:27.937599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65420db271604e7ebd3a3527ec820e07)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:27.943115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:27.950044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 707/1400] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:28.004884 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e098d-3153-42c1-83de-a711965769f7 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:28.005160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e098d-3153-42c1-83de-a711965769f7 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:28.005610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e098d-3153-42c1-83de-a711965769f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:28.160633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d83e098d-3153-42c1-83de-a711965769f7 None None] MFA Rules not processed for user `6c5db537b1ad455395e4c9a931036c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:28.165136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d83e098d-3153-42c1-83de-a711965769f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:28.179171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65420db271604e7ebd3a3527ec820e07'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:28.182145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65420db271604e7ebd3a3527ec820e07'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:28.270387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65420db271604e7ebd3a3527ec820e07'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:28.272868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:28.312132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:28.315675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65420db271604e7ebd3a3527ec820e07'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:28.317231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4ca616a1-9b8d-4890-9d01-f0928bbaf603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65420db271604e7ebd3a3527ec820e07'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:28.364296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 694/1401] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:27 2022] DELETE /identity/v3/users/65420db271604e7ebd3a3527ec820e07 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:28.369496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:28.369952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:28.370389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:28.435697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 708/1402] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:28.441235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:28.449592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:28.458029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a377d-b371-4570-9b39-cff98d43e20d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:28.458654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a377d-b371-4570-9b39-cff98d43e20d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:28.462031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a377d-b371-4570-9b39-cff98d43e20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:28.534829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a71a377d-b371-4570-9b39-cff98d43e20d None None] MFA Rules not processed for user `6c5db537b1ad455395e4c9a931036c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:28.538190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a71a377d-b371-4570-9b39-cff98d43e20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:28.792133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 695/1403] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:28.824484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:28.828380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:28.896160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 709/1404] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:28.930112 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83268fd-8e95-4464-8c31-d2c9185a53cb None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:28.931458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83268fd-8e95-4464-8c31-d2c9185a53cb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:28.932217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83268fd-8e95-4464-8c31-d2c9185a53cb None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:28.935244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 710/1405] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 11 12:00:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:00:28.937443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83268fd-8e95-4464-8c31-d2c9185a53cb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:28.946805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b83268fd-8e95-4464-8c31-d2c9185a53cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:29.039803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83268fd-8e95-4464-8c31-d2c9185a53cb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:29.046958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:29.048874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:29.049803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:29.050309 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] PATH_INFO: `/v3/projects/8a0aa51431044afebd3b2c606cca83de` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:29.053287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0aa51431044afebd3b2c606cca83de)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:29.056219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:29.166353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0aa51431044afebd3b2c606cca83de', 'request_id': 'req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:29.178966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0aa51431044afebd3b2c606cca83de', 'request_id': 'req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:29.197326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0aa51431044afebd3b2c606cca83de', 'request_id': 'req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:29.197556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa31b-d850-4c3f-9d94-6d3cc755793c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:29.239028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] The token cache is being invalidate because project 8a0aa51431044afebd3b2c606cca83de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:29.239795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:29.240746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-89eb5554-dcaf-41bb-ab44-7c87c18fd11f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:29.242943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 711/1406] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:28 2022] DELETE /identity/v3/projects/8a0aa51431044afebd3b2c606cca83de => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:29.245388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b52afb-6921-4346-a442-1517a18997b6 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:29.245878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b52afb-6921-4346-a442-1517a18997b6 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:29.246338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b52afb-6921-4346-a442-1517a18997b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:29.280736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-40b52afb-6921-4346-a442-1517a18997b6 None None] MFA Rules not processed for user `985db5d7ded74dbeaa8fae4515fea049`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:29.299438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-40b52afb-6921-4346-a442-1517a18997b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:29.376957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72471db0-b916-4e0a-abcb-9daaefbd18f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:29.378035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72471db0-b916-4e0a-abcb-9daaefbd18f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:29.378501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72471db0-b916-4e0a-abcb-9daaefbd18f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:29.378961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72471db0-b916-4e0a-abcb-9daaefbd18f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:29.383512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-72471db0-b916-4e0a-abcb-9daaefbd18f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:29.480747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 712/1407] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:29.483426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:29.484397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:29.485579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:29.506727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:29.553873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:29.555224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:29.581606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:29.627389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72471db0-b916-4e0a-abcb-9daaefbd18f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:29.630301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72471db0-b916-4e0a-abcb-9daaefbd18f7 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:29.660492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 696/1408] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:00:29.662098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a40a94-5fbc-40f9-9fda-f0d6750283b3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:29.662421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a40a94-5fbc-40f9-9fda-f0d6750283b3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:29.662785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a40a94-5fbc-40f9-9fda-f0d6750283b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:29.758169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 713/1409] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:29.759156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:29.768373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:29.819684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295d554-602e-4753-bb73-fffae9dc72dc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:29.858242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2479ba-5ef8-401a-9860-f837dea9cbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:29.864564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2479ba-5ef8-401a-9860-f837dea9cbff service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:29.866081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2479ba-5ef8-401a-9860-f837dea9cbff service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:29.873206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2479ba-5ef8-401a-9860-f837dea9cbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:29.895366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2479ba-5ef8-401a-9860-f837dea9cbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:29.900149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2479ba-5ef8-401a-9860-f837dea9cbff service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:29.930375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-41a40a94-5fbc-40f9-9fda-f0d6750283b3 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:29.932904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-41a40a94-5fbc-40f9-9fda-f0d6750283b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:29.933987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 714/1410] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:29.938547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621e935-c812-46d8-9473-acc424de8fa2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:29.941552 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621e935-c812-46d8-9473-acc424de8fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:29.942742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621e935-c812-46d8-9473-acc424de8fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:30.016135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f621e935-c812-46d8-9473-acc424de8fa2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:30.023946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f621e935-c812-46d8-9473-acc424de8fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:30.057632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 715/1411] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:30.064642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621e935-c812-46d8-9473-acc424de8fa2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:30.113404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621e935-c812-46d8-9473-acc424de8fa2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:30.140660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:30.143435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:30.144784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:30.147354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:30.153831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:30.156949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:30.169104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:30.249626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 716/1412] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:00:30.257057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:30.292420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4934-0479-45ce-8f65-faeee93255bd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:30.305888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:30.309297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:30.309725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:30.309999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:30.312895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:30.321577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 697/1413] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 660 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:30.331752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:30.448298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 717/1414] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:30 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:30.454716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a40a94-5fbc-40f9-9fda-f0d6750283b3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:30.496639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a40a94-5fbc-40f9-9fda-f0d6750283b3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:30.673370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:30.678833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:30.749177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:30.750711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:30.751160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:30.751900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:30.753373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:30.758002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:30.840106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 698/1415] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:30 2022] POST /identity/v3/users => generated 283 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:30.845511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:30.854031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:30.989409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4c32d-7f5c-4083-b116-4f77107a21b3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:31.017352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:31.018666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:31.019273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:31.020498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:31.035492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:31.120537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbbe16-d0ff-40be-9843-97e6f2e43cf2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:31.137577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:31.138660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:31.138940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:31.139393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:31.142007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:31.147636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:31.220838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:31.222725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:31.268014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 718/1416] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:00:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:00:31.270058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:31.318691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c3a5-ca00-4e61-9a80-91289d1453bf service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:31.330697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:31.331784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:31.331784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:31.331938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:31.333166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:31.336049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:31.355865 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 719/1417] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:31.360109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:31.394772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:31.399189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:31.407929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4e32a-3cab-4465-a664-bf02a99c8cc5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:31.418493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 699/1418] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:31.433669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb878b6-9aa0-4e29-ab73-eccfa2140ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:31.434891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb878b6-9aa0-4e29-ab73-eccfa2140ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:31.434891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb878b6-9aa0-4e29-ab73-eccfa2140ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:31.440456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb878b6-9aa0-4e29-ab73-eccfa2140ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:31.446218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb878b6-9aa0-4e29-ab73-eccfa2140ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:31.457370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb878b6-9aa0-4e29-ab73-eccfa2140ec1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:31.536099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:31.538604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 720/1419] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:31.575009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c648e7-61fe-4080-9abb-be5435054c47 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:31.592885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:31.600711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:31.601919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:31.602748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] PATH_INFO: `/v3/projects/8a1dd97718354cb38e80ca4da0336717/users/0ef9ab1484944563ac38f24fcbf73f7f/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:31.672360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1dd97718354cb38e80ca4da0336717, user_id=0ef9ab1484944563ac38f24fcbf73f7f, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:31.685087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:31.756654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 700/1420] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:31 2022] PUT /identity/v3/projects/8a1dd97718354cb38e80ca4da0336717/users/0ef9ab1484944563ac38f24fcbf73f7f/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:31.761150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee25d5-350c-4ece-bba3-4909098c3617 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:31.761857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee25d5-350c-4ece-bba3-4909098c3617 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:31.762158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee25d5-350c-4ece-bba3-4909098c3617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:31.930730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-60ee25d5-350c-4ece-bba3-4909098c3617 None None] MFA Rules not processed for user `0ef9ab1484944563ac38f24fcbf73f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:31.932506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-60ee25d5-350c-4ece-bba3-4909098c3617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:32.372640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 721/1421] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:32.376600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:32.647232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82f0fe-6d57-407b-ac01-fc49eb629d3d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:32.670886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:32.670886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:32.670886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:32.670886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:32.671362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:32.673326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:32.784420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 701/1422] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:32 2022] POST /identity/v3/projects => generated 365 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:32.785752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee25d5-350c-4ece-bba3-4909098c3617 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:32.806361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee25d5-350c-4ece-bba3-4909098c3617 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:33.232321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:33.235230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:33.246443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:33.246443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:33.246443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:33.260473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:33.353259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 722/1423] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:32 2022] POST /identity/v3/users => generated 289 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:33.357951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:33.380438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e295d-7acd-41fd-9f5d-2175258473b3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:33.416793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:33.421018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:33.425522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:33.425964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:33.426741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:33.436937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:33.497272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:33.504644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 702/1424] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:33.527313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568876-ad23-4bc0-b9fb-f1a61ae751dd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:33.549581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:33.555051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:33.555946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:33.560008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] PATH_INFO: `/v3/projects/65092ad52b5643f6a5a4bf1929f3aa88/users/b207d4df3a7548e19a14ffdef16f9edb/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:33.658837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65092ad52b5643f6a5a4bf1929f3aa88, user_id=b207d4df3a7548e19a14ffdef16f9edb, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:33.684528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:33.819612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 723/1425] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:33 2022] PUT /identity/v3/projects/65092ad52b5643f6a5a4bf1929f3aa88/users/b207d4df3a7548e19a14ffdef16f9edb/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:33.821431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:33.864289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a2612-df7d-4ab4-8b5a-98a9e8274f10 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:34.099606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:34.189294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:34.190143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:34.190505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:34.196091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:34.197002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:34.199033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:34.235587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 703/1426] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:34.236871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:34.272147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:34.287710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:34.291641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:34.303167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c54f0a-01e8-402b-817a-288f56e3686c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:34.319390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70186c0a-ee5e-49da-8192-8d40543cb24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:34.320106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70186c0a-ee5e-49da-8192-8d40543cb24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:34.320383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70186c0a-ee5e-49da-8192-8d40543cb24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:34.320655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70186c0a-ee5e-49da-8192-8d40543cb24a admin admin] PATH_INFO: `/v3/projects/65092ad52b5643f6a5a4bf1929f3aa88/users/b207d4df3a7548e19a14ffdef16f9edb/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:34.325462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70186c0a-ee5e-49da-8192-8d40543cb24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65092ad52b5643f6a5a4bf1929f3aa88, user_id=b207d4df3a7548e19a14ffdef16f9edb, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:34.332757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70186c0a-ee5e-49da-8192-8d40543cb24a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:34.342932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5968c-4f15-42ee-a830-a747938c3001 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:34.360808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 724/1427] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:34 2022] PUT /identity/v3/projects/65092ad52b5643f6a5a4bf1929f3aa88/users/b207d4df3a7548e19a14ffdef16f9edb/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:34.380369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30699e6-f40a-4f3c-a993-f56b94756c89 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:34.380696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30699e6-f40a-4f3c-a993-f56b94756c89 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:34.380970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30699e6-f40a-4f3c-a993-f56b94756c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:34.529334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b30699e6-f40a-4f3c-a993-f56b94756c89 None None] MFA Rules not processed for user `b207d4df3a7548e19a14ffdef16f9edb`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:34.533559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b30699e6-f40a-4f3c-a993-f56b94756c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:34.682170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:34.685627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:34.686263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:34.698798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] PATH_INFO: `/v3/projects/880fe01f8811463db834b3c59d62b96e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:34.698798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=880fe01f8811463db834b3c59d62b96e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:34.718931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:34.931417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 725/1428] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 553 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:34.937089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:34.939231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:34.941174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:35.017078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] MFA Rules not processed for user `6c5db537b1ad455395e4c9a931036c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:35.019343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:35.093090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880fe01f8811463db834b3c59d62b96e', 'request_id': 'req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:35.172909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880fe01f8811463db834b3c59d62b96e', 'request_id': 'req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:35.226757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880fe01f8811463db834b3c59d62b96e', 'request_id': 'req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:35.345660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] The token cache is being invalidate because project 880fe01f8811463db834b3c59d62b96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:35.346140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:35.362650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:35.383855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 704/1429] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:34 2022] DELETE /identity/v3/projects/880fe01f8811463db834b3c59d62b96e => generated 0 bytes in 1098 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:35.393015 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:35.398187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:35.460032 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 726/1430] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:35.462111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:35.474347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:35.706199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2581-5203-43d7-a2e1-8c5373f3b36d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:35.715902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:35.718078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:35.718789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:35.720640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:35.725499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:35.842414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:35.966321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dca80d-32b2-465f-b24d-f9f3326ba42b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:35.977955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:35.986818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:35.987696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:35.988440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] PATH_INFO: `/v3/users/00942f574aaf49d8b50b1ebb960efaca` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:35.991556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=00942f574aaf49d8b50b1ebb960efaca)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:36.001942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:36.162100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:36.172696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:36.176635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:36.237594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 705/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 853 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:36.264087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00942f574aaf49d8b50b1ebb960efaca'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:36.267340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00942f574aaf49d8b50b1ebb960efaca'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:36.289598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00942f574aaf49d8b50b1ebb960efaca'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:36.324389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00942f574aaf49d8b50b1ebb960efaca'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:36.434288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-fb2284f7-0028-42ec-a41c-628fdad069fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00942f574aaf49d8b50b1ebb960efaca'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:36.448079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 727/1432] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:35 2022] DELETE /identity/v3/users/00942f574aaf49d8b50b1ebb960efaca => generated 0 bytes in 987 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:36.579766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:36.597167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25798b5e-703b-4d70-8ea9-b0fb481b69b3 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:36.819706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574455cd-425a-4822-8d6b-c31701b937d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:36.820379 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574455cd-425a-4822-8d6b-c31701b937d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:36.823965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574455cd-425a-4822-8d6b-c31701b937d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:36.825484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574455cd-425a-4822-8d6b-c31701b937d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:36.836454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-574455cd-425a-4822-8d6b-c31701b937d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:37.065266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574455cd-425a-4822-8d6b-c31701b937d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:37.070572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574455cd-425a-4822-8d6b-c31701b937d2 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:37.099921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 706/1433] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:37.950184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:37.951246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:37.951845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:38.016228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] MFA Rules not processed for user `89f04c92184043c3a6cd7249340519dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:38.023683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:38.136665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:38.138753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:38.148040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:38.184871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] MFA Rules not processed for user `985db5d7ded74dbeaa8fae4515fea049`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:38.208441 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:38.241546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 728/1434] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:38.383000 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 707/1435] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Oct 11 12:00:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:38.410589 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:38.412923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:38.437106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543271ad-8481-4668-a8d6-7c081a1b16ef None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:38.461572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b288d-1dab-4384-b238-c7430aa82d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:38.463063 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b288d-1dab-4384-b238-c7430aa82d9c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:38.463918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b288d-1dab-4384-b238-c7430aa82d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:38.464673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b288d-1dab-4384-b238-c7430aa82d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:38.496789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b288d-1dab-4384-b238-c7430aa82d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:38.499101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b288d-1dab-4384-b238-c7430aa82d9c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:38.521354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 729/1436] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:38.905673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:38.907354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:39.036780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:39.339496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f1916-1bd7-486e-8fa0-1f6ac2862c44 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:39.375564 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:39.376247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:39.376594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:39.376859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] PATH_INFO: `/v3/projects/126f31f848dc48a59bab720cc4b80256` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:39.380962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126f31f848dc48a59bab720cc4b80256)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:39.383145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:39.611832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126f31f848dc48a59bab720cc4b80256', 'request_id': 'req-1ff77ebb-1c22-478e-8925-9d887d779c94'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:39.665196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126f31f848dc48a59bab720cc4b80256', 'request_id': 'req-1ff77ebb-1c22-478e-8925-9d887d779c94'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:39.724102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126f31f848dc48a59bab720cc4b80256', 'request_id': 'req-1ff77ebb-1c22-478e-8925-9d887d779c94'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:39.845355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] The token cache is being invalidate because project 126f31f848dc48a59bab720cc4b80256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:39.845802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:39.864955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1ff77ebb-1c22-478e-8925-9d887d779c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:39.878954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 708/1437] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:38 2022] DELETE /identity/v3/projects/126f31f848dc48a59bab720cc4b80256 => generated 0 bytes in 974 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:39.888054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8e56a-57eb-4514-91a3-ae6a802d282f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:39.888653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8e56a-57eb-4514-91a3-ae6a802d282f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:39.888757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8e56a-57eb-4514-91a3-ae6a802d282f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:39.995213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f9d8e56a-57eb-4514-91a3-ae6a802d282f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:40.001039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f9d8e56a-57eb-4514-91a3-ae6a802d282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:40.337528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 730/1438] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:40.345148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7134e5-d354-4f27-b3af-825b272a735b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:40.346088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7134e5-d354-4f27-b3af-825b272a735b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:40.346088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7134e5-d354-4f27-b3af-825b272a735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:40.430828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6c7134e5-d354-4f27-b3af-825b272a735b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:40.430828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6c7134e5-d354-4f27-b3af-825b272a735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:40.465997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 709/1439] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:40.468742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8e56a-57eb-4514-91a3-ae6a802d282f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:40.500565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8e56a-57eb-4514-91a3-ae6a802d282f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:40.527295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:40.530951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:40.532561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:40.535081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:40.541786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:40.544028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:40.556459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:40.659792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 731/1440] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:00:40.665636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7134e5-d354-4f27-b3af-825b272a735b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:40.680694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7134e5-d354-4f27-b3af-825b272a735b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:40.691140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:40.693211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:40.694637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:40.695305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:40.696302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:40.702437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:40.781516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 710/1441] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:40 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:40.785806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:40.810282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db0d5c-5857-4fbf-9bc2-dd8e5ade48ad admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:40.865879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:41.095927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:41.098655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:41.099239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:41.099504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:41.102214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:41.109440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:41.177890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 732/1442] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:40 2022] POST /identity/v3/users => generated 293 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:41.181698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:41.194895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70e1d2-6724-45a0-b214-cc74c652b945 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:41.211543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:41.214861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:41.217510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:41.218990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:41.222150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:41.227009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:41.258832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 711/1443] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:41.260518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:41.275780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46f1df-9cc0-4bc1-b45f-68ea85266a2d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:41.293580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e98432-19c1-4111-88ef-499457ce4acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:41.295603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98432-19c1-4111-88ef-499457ce4acd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:41.296649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98432-19c1-4111-88ef-499457ce4acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:41.297962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98432-19c1-4111-88ef-499457ce4acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:41.300103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e98432-19c1-4111-88ef-499457ce4acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:41.306481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e98432-19c1-4111-88ef-499457ce4acd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:41.344351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:41.354857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 733/1444] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:41.357871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a7f54-c8cb-4ec8-8005-feaef6904851 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:41.381165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:41.382281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:41.382739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:41.383265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] PATH_INFO: `/v3/projects/1aaf190ec26d4f1588dda1ae20b2d6a9/users/efd831df7e7e4da8b6841c9406b42a9e/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:41.440532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aaf190ec26d4f1588dda1ae20b2d6a9, user_id=efd831df7e7e4da8b6841c9406b42a9e, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:41.444972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:41.490796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 712/1445] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:41 2022] PUT /identity/v3/projects/1aaf190ec26d4f1588dda1ae20b2d6a9/users/efd831df7e7e4da8b6841c9406b42a9e/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:41.502584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7fedb-b0d5-4a32-a446-92b6a008d707 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:41.503136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7fedb-b0d5-4a32-a446-92b6a008d707 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:41.503854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7fedb-b0d5-4a32-a446-92b6a008d707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:41.579230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b0e7fedb-b0d5-4a32-a446-92b6a008d707 None None] MFA Rules not processed for user `efd831df7e7e4da8b6841c9406b42a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:41.581565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b0e7fedb-b0d5-4a32-a446-92b6a008d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:41.753204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:41.755952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:41.892496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 734/1446] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:41.897093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7fedb-b0d5-4a32-a446-92b6a008d707 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:41.974843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:42.068979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31dcb-3dba-4eb3-abce-8212052d6136 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:42.094852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:42.098012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:42.099020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:42.099299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] PATH_INFO: `/v3/users/0ef9ab1484944563ac38f24fcbf73f7f` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:42.108109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef9ab1484944563ac38f24fcbf73f7f)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:42.112102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:42.188723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7fedb-b0d5-4a32-a446-92b6a008d707 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:42.203021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:42.205232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:42.206275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:42.207144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:42.208621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:42.213127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:42.246652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef9ab1484944563ac38f24fcbf73f7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.247598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef9ab1484944563ac38f24fcbf73f7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.287779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 735/1447] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:41 2022] POST /identity/v3/projects => generated 387 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:42.292927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef9ab1484944563ac38f24fcbf73f7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.296105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:42.316076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef9ab1484944563ac38f24fcbf73f7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.319116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef9ab1484944563ac38f24fcbf73f7f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.372827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 713/1448] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:41 2022] DELETE /identity/v3/users/0ef9ab1484944563ac38f24fcbf73f7f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:42.374113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:42.377314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:42.409697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:42.640550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781b6b7-8a58-4fca-8fb9-6d96948af8bc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:42.653682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb36a-c6b4-4505-9245-d0c8b06e80f3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:42.655755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846570b4-7661-4057-bd77-fba92bc6c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:42.658572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846570b4-7661-4057-bd77-fba92bc6c278 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:42.659048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846570b4-7661-4057-bd77-fba92bc6c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:42.659516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846570b4-7661-4057-bd77-fba92bc6c278 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:42.662908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846570b4-7661-4057-bd77-fba92bc6c278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:42.671059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:42.671639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:42.671918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:42.672185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] PATH_INFO: `/v3/users/23ce0c30547845b38a2d8aa98cae9a81` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:42.673343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846570b4-7661-4057-bd77-fba92bc6c278 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:42.677260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ce0c30547845b38a2d8aa98cae9a81)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:42.687800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:42.731188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 736/1449] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:42 2022] POST /identity/v3/users => generated 294 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:42.733184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:42.733474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:42.733810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:42.796115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:42.797416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:42.812870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ce0c30547845b38a2d8aa98cae9a81'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.814537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ce0c30547845b38a2d8aa98cae9a81'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.823029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 737/1450] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:42.824991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:42.829136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:42.851887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ce0c30547845b38a2d8aa98cae9a81'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.855355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:42.866481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f73773-8f1f-4058-ac8e-b7098863728c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:42.874932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ce0c30547845b38a2d8aa98cae9a81'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.876206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-83d1dfaf-d117-4b0a-b6cd-2a59a4ca229d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ce0c30547845b38a2d8aa98cae9a81'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:42.881826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:42.882491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:42.882787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:42.883111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:42.883834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:42.889818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:42.909995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 714/1451] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:42 2022] DELETE /identity/v3/users/23ce0c30547845b38a2d8aa98cae9a81 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:42.916320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:42.916721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:42.918213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:42.924092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 738/1452] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:42.927819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:42.933858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:43.010643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d3741-d85d-4798-8f39-c2c70b2e1ea3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:43.014543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:43.016083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:43.255970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:43.258688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:43.259455 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:43.259902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:43.260769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:43.264897 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:43.300221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 715/1453] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:43.300221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:43.302060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:43.308704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 739/1454] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:43.314994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:43.365891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4d2b9-a965-4b6b-bb1b-a7048892586d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:43.428390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d844b-8d3b-4ef7-a3c3-01fa992e981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:43.432020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d844b-8d3b-4ef7-a3c3-01fa992e981e admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:43.433475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d844b-8d3b-4ef7-a3c3-01fa992e981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:43.433928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d844b-8d3b-4ef7-a3c3-01fa992e981e admin admin] PATH_INFO: `/v3/projects/e38f5faf63004a8eb32afa09c2f5dde0/users/e7dad742f510480eb237ed5b4c4a9e2a/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:43.453783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f88ffa-4f07-4e2d-b219-dbb9637a85cb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:43.459558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c8c03-2ce8-4826-b1e9-1b233e6c6c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:43.460209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c8c03-2ce8-4826-b1e9-1b233e6c6c7d service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:43.460488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c8c03-2ce8-4826-b1e9-1b233e6c6c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:43.460762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c8c03-2ce8-4826-b1e9-1b233e6c6c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:43.466957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4d0c8c03-2ce8-4826-b1e9-1b233e6c6c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:43.495888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c8c03-2ce8-4826-b1e9-1b233e6c6c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:43.497419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c8c03-2ce8-4826-b1e9-1b233e6c6c7d service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:43.537584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 716/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:43.539370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bdf96-dcad-4532-b770-7188f646eb65 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:43.539654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bdf96-dcad-4532-b770-7188f646eb65 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:43.539922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bdf96-dcad-4532-b770-7188f646eb65 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:43.549427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 717/1456] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:00:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:00:43.550349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bdf96-dcad-4532-b770-7188f646eb65 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:43.552634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d844b-8d3b-4ef7-a3c3-01fa992e981e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38f5faf63004a8eb32afa09c2f5dde0, user_id=e7dad742f510480eb237ed5b4c4a9e2a, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:43.561789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d844b-8d3b-4ef7-a3c3-01fa992e981e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:43.566423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2f9bdf96-dcad-4532-b770-7188f646eb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:43.612058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 740/1457] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:43 2022] PUT /identity/v3/projects/e38f5faf63004a8eb32afa09c2f5dde0/users/e7dad742f510480eb237ed5b4c4a9e2a/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:43.614393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bdf96-dcad-4532-b770-7188f646eb65 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:43.615242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e8b9-d714-431a-9823-69a2e02c1e02 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:43.615564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e8b9-d714-431a-9823-69a2e02c1e02 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:43.615909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e8b9-d714-431a-9823-69a2e02c1e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:43.709536 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7824e8b9-d714-431a-9823-69a2e02c1e02 None None] MFA Rules not processed for user `e7dad742f510480eb237ed5b4c4a9e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:43.714148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7824e8b9-d714-431a-9823-69a2e02c1e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:43.773106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:43.773938 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:43.774116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:43.774283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:43.835915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:43.896958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:43.912064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 741/1458] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:43.914675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:43.914996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:43.915517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:43.960512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:43.962279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:43.962757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:43.964323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:43.986241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 718/1459] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:43.987234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:44.010285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22461e7-77ee-42b3-9409-300c14db39b8 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:44.021652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:44.022444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:44.022777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:44.022999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:44.023647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:44.028113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:44.127615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 719/1460] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:43 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:44.128930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:44.135648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 742/1461] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:44.352820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27373e37-a74d-4d70-a88d-6263d3b7d777 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:44.369178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:44.370104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:44.370473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:44.370773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:44.371478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:44.375285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:44.401178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:44.408181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:44.434380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70b008-f3ec-4d2e-b5b1-2bc35273d9d4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:44.435054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 720/1462] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:44 2022] POST /identity/v3/users => generated 300 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:44.441026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:44.467263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf827-f15d-4cd6-888f-60018befa4e8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:44.485369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:44.486019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:44.486344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:44.486733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:44.487527 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:44.489474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:44.531986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 721/1463] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:44.538194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:44.578535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8344d-2887-4e2c-b3f6-362eee793ac4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:44.609621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:44.612405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:44.612708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:44.618108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:44.620583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] PATH_INFO: `/v3/projects/6596031564664b87b244eee87694a77d/users/885e12e8829f43858f5a1d81443700c3/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:44.623598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:44.625187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:44.625477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:44.668591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:44.672166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6596031564664b87b244eee87694a77d, user_id=885e12e8829f43858f5a1d81443700c3, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:44.672896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:44.675613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:44.692470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 743/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:00:44.712091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 722/1465] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:44 2022] PUT /identity/v3/projects/6596031564664b87b244eee87694a77d/users/885e12e8829f43858f5a1d81443700c3/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:44.716617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:44.734753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282114e4-28fb-4a8a-837d-8019c29370f3 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:44.944159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc2921-af91-4fba-8e02-918609046f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:44.944646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc2921-af91-4fba-8e02-918609046f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:44.944933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc2921-af91-4fba-8e02-918609046f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:44.945210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc2921-af91-4fba-8e02-918609046f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:44.945899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc2921-af91-4fba-8e02-918609046f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:44.952515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc2921-af91-4fba-8e02-918609046f28 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:44.975082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:44.990496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:45.001025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 744/1466] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:45.011822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18716ca-97bb-41c4-9f26-1075a5c1c701 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:45.035284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:45.042463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:45.042873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:45.043211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] PATH_INFO: `/v3/projects/6596031564664b87b244eee87694a77d/users/885e12e8829f43858f5a1d81443700c3/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:45.047394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6596031564664b87b244eee87694a77d, user_id=885e12e8829f43858f5a1d81443700c3, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:45.051721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:45.105864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 723/1467] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:44 2022] PUT /identity/v3/projects/6596031564664b87b244eee87694a77d/users/885e12e8829f43858f5a1d81443700c3/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:45.118125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:45.118620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:45.119029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:45.211845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] MFA Rules not processed for user `885e12e8829f43858f5a1d81443700c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:45.213998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:45.585295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 745/1468] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:45.597669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:45.600094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:45.836508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cccd7-9272-44ab-ade0-fd45df657ce7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:45.841244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:45.842772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:45.843245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:45.844695 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:45.857963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:45.860300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:45.869923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:45.893334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 724/1469] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:47.181191 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:47.189635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:47.368333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:47.371435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:47.404387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880085b0-690f-4979-bb7a-b9ea99f11327 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:47.416282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:47.419319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:47.419999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:47.420324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:47.429120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:47.468177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6646-3382-4a91-a76e-7b966c2b3535 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:47.476793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:47.477890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:47.478405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:47.478989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] PATH_INFO: `/v3/projects/8a1dd97718354cb38e80ca4da0336717` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:47.480795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1dd97718354cb38e80ca4da0336717)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:47.484265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:47.576427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:47.588398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:47.627058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 725/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:47.635926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1dd97718354cb38e80ca4da0336717', 'request_id': 'req-39eba8d1-083a-41cf-825f-ad765ba2b54e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:47.665401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1dd97718354cb38e80ca4da0336717', 'request_id': 'req-39eba8d1-083a-41cf-825f-ad765ba2b54e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:47.696599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1dd97718354cb38e80ca4da0336717', 'request_id': 'req-39eba8d1-083a-41cf-825f-ad765ba2b54e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:47.731319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] The token cache is being invalidate because project 8a1dd97718354cb38e80ca4da0336717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:47.731728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:47.745143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:47.749854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 746/1471] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:47 2022] DELETE /identity/v3/projects/8a1dd97718354cb38e80ca4da0336717 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:47.751252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:47.773671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a635b-a9ca-4b92-b57c-b3ce9d514222 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:47.940013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:47.941365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:47.942315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:47.942430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] PATH_INFO: `/v3/users/b207d4df3a7548e19a14ffdef16f9edb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:47.955799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b207d4df3a7548e19a14ffdef16f9edb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:47.961489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:48.179173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b207d4df3a7548e19a14ffdef16f9edb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:48.179955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b207d4df3a7548e19a14ffdef16f9edb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:48.213291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b207d4df3a7548e19a14ffdef16f9edb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:48.233002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b207d4df3a7548e19a14ffdef16f9edb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:48.234894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b207d4df3a7548e19a14ffdef16f9edb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:48.263791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 726/1472] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:47 2022] DELETE /identity/v3/users/b207d4df3a7548e19a14ffdef16f9edb => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:50.434348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:50.437878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:50.459765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eba8d1-083a-41cf-825f-ad765ba2b54e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:50.527467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:50.628473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:50.629192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:50.629652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:50.629813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] PATH_INFO: `/v3/projects/e923531030884fce945d5e14940d8ef5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:50.632966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e923531030884fce945d5e14940d8ef5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:50.636123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:50.786581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e923531030884fce945d5e14940d8ef5', 'request_id': 'req-9bbd640c-4596-4a49-97f1-6f6ccd49d272'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:50.790780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e923531030884fce945d5e14940d8ef5', 'request_id': 'req-9bbd640c-4596-4a49-97f1-6f6ccd49d272'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:50.801585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e923531030884fce945d5e14940d8ef5', 'request_id': 'req-9bbd640c-4596-4a49-97f1-6f6ccd49d272'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:50.815362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] The token cache is being invalidate because project e923531030884fce945d5e14940d8ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:50.815837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:50.816683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9bbd640c-4596-4a49-97f1-6f6ccd49d272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:50.822026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 747/1473] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:50 2022] DELETE /identity/v3/projects/e923531030884fce945d5e14940d8ef5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:50.823853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:50.825476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:50.856048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093070a-4eae-43be-a55e-43ab00598cb4 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:50.856048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093070a-4eae-43be-a55e-43ab00598cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:50.856048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093070a-4eae-43be-a55e-43ab00598cb4 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:50.857825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 748/1474] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:00:50.859948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e6d69-2810-42fa-ba44-db8864f91732 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:50.890182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:50.890679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:50.891051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:50.903605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:50.937922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:50.939222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:51.031540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:51.032375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:51.032755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:51.033125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] PATH_INFO: `/v3/users/138423a63baa4c1aa3da1b7296e2d4f7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:51.034588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=138423a63baa4c1aa3da1b7296e2d4f7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:51.036733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:51.153847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138423a63baa4c1aa3da1b7296e2d4f7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.154941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138423a63baa4c1aa3da1b7296e2d4f7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.162697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 749/1475] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:51.166923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:51.174296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138423a63baa4c1aa3da1b7296e2d4f7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.182848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:51.185720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138423a63baa4c1aa3da1b7296e2d4f7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.187266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1c06d24-47c9-4d04-9dec-1fd2e1eede16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138423a63baa4c1aa3da1b7296e2d4f7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.210073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008eaba-c83a-4768-bef0-c48623d81298 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:51.218286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 727/1476] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:50 2022] DELETE /identity/v3/users/138423a63baa4c1aa3da1b7296e2d4f7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:51.243484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:51.244758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:51.244925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:51.245386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] PATH_INFO: `/v3/projects/65092ad52b5643f6a5a4bf1929f3aa88` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:51.250194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65092ad52b5643f6a5a4bf1929f3aa88)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:51.268786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:51.396544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:51.419170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65092ad52b5643f6a5a4bf1929f3aa88', 'request_id': 'req-5c6454dd-8c84-44d8-a835-b53b6094662f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.441590 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65092ad52b5643f6a5a4bf1929f3aa88', 'request_id': 'req-5c6454dd-8c84-44d8-a835-b53b6094662f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.474272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65092ad52b5643f6a5a4bf1929f3aa88', 'request_id': 'req-5c6454dd-8c84-44d8-a835-b53b6094662f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.496906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] The token cache is being invalidate because project 65092ad52b5643f6a5a4bf1929f3aa88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:51.497085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.498061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5c6454dd-8c84-44d8-a835-b53b6094662f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:51.504931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 750/1477] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:51 2022] DELETE /identity/v3/projects/65092ad52b5643f6a5a4bf1929f3aa88 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:51.510281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95252f39-abe8-4fbd-8279-f667c18c9d1a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:51.511008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95252f39-abe8-4fbd-8279-f667c18c9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:51.511700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95252f39-abe8-4fbd-8279-f667c18c9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:51.556178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-95252f39-abe8-4fbd-8279-f667c18c9d1a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:51.560270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-95252f39-abe8-4fbd-8279-f667c18c9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:51.720320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 728/1478] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:51.732640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:51.732987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:51.733260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:51.813644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:51.819176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:51.865871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 751/1479] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:51.872409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95252f39-abe8-4fbd-8279-f667c18c9d1a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:51.925465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95252f39-abe8-4fbd-8279-f667c18c9d1a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:51.952157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:51.955904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:51.957662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:51.958371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:51.959607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:51.961090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:51.962438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:51.964629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:51.969224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:52.024439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 729/1480] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:00:52.025598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:52.052395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1282f6-5f76-47ad-88ae-db41699a756d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:52.069005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:52.070529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:52.071177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:52.071939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:52.074462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:52.081640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:52.170591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:52.213342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 730/1481] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:52 2022] POST /identity/v3/projects => generated 359 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:52.218639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:52.286350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276f015-33a0-4117-8c13-188b8b5f4a8f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:52.408203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6f44-99a9-433f-ac8d-88859ce8c194 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:52.431585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:52.432298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:52.432578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:52.432906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:52.433493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:52.435661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:52.445478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:52.447148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:52.447735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:52.448167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:52.453529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:52.475519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:52.477644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:52.479851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 731/1482] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:52 2022] POST /identity/v3/users => generated 280 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:52.485370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:52.491882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 752/1483] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:52.503126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ce4c-5c99-4758-8f72-c06425e95a88 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:52.508869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:52.509517 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:52.509789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:52.510050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:52.510898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:52.512828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:52.525895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 732/1484] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:52.531773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:52.555118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c5c0-ff42-4a78-b5e1-f0a3a5074f6a service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:52.566914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbb560-6608-4778-ad4d-90b0ed22cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:52.568289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbb560-6608-4778-ad4d-90b0ed22cf7d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:52.571178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbb560-6608-4778-ad4d-90b0ed22cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:52.572273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbb560-6608-4778-ad4d-90b0ed22cf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:52.575711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbb560-6608-4778-ad4d-90b0ed22cf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:52.579096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbb560-6608-4778-ad4d-90b0ed22cf7d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:52.606612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 753/1485] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:52.610606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:52.628730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681af5cf-599b-4e03-bc1e-c3df1b8baeb4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:52.637046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:52.637835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:52.638183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:52.638860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] PATH_INFO: `/v3/projects/ed43d1f17bfb4d3da6951e3b7ac486bf/users/64f22ba472f840a09f31b2fbca0314e5/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:52.665861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed43d1f17bfb4d3da6951e3b7ac486bf, user_id=64f22ba472f840a09f31b2fbca0314e5, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:52.670084 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:52.695321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 733/1486] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:52 2022] PUT /identity/v3/projects/ed43d1f17bfb4d3da6951e3b7ac486bf/users/64f22ba472f840a09f31b2fbca0314e5/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:52.713649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630215-d769-4505-9e7f-c1a13f3180cf None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:52.714224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630215-d769-4505-9e7f-c1a13f3180cf None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:52.714901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630215-d769-4505-9e7f-c1a13f3180cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:52.757102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f1630215-d769-4505-9e7f-c1a13f3180cf None None] MFA Rules not processed for user `64f22ba472f840a09f31b2fbca0314e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:52.758219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f1630215-d769-4505-9e7f-c1a13f3180cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:52.793072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:52.884765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 754/1487] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:52.965258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:52.967898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:53.107925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dda96-4bb7-4d57-be91-46ebde72c2e0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:53.112061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:53.112705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:53.113603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:53.113603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:53.134456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:53.136025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:53.159306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 734/1488] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:53.187348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630215-d769-4505-9e7f-c1a13f3180cf None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:53.335855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630215-d769-4505-9e7f-c1a13f3180cf None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:53.344512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:53.345443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:53.345975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:53.346449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] PATH_INFO: `/v3/users/64f22ba472f840a09f31b2fbca0314e5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:53.348079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f22ba472f840a09f31b2fbca0314e5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:53.350690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:53.400809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:53.404449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:53.430931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d368710-cc3d-4a70-80f1-b4065b80efa2 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:53.453431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699c375-eac7-4b87-a544-8d4a01611e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:53.455066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c375-eac7-4b87-a544-8d4a01611e9c service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:53.458656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c375-eac7-4b87-a544-8d4a01611e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:53.458876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699c375-eac7-4b87-a544-8d4a01611e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:53.466932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b699c375-eac7-4b87-a544-8d4a01611e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:53.517195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f22ba472f840a09f31b2fbca0314e5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:53.517927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f22ba472f840a09f31b2fbca0314e5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:53.535293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f22ba472f840a09f31b2fbca0314e5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:53.553376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f22ba472f840a09f31b2fbca0314e5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:53.575663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f22ba472f840a09f31b2fbca0314e5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:53.591127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 755/1489] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:53 2022] DELETE /identity/v3/users/64f22ba472f840a09f31b2fbca0314e5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:53.597677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:53.598998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:53.655769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:53.661655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c375-eac7-4b87-a544-8d4a01611e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:53.665896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699c375-eac7-4b87-a544-8d4a01611e9c service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:53.691996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 735/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:53.694914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:53.695831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:53.695831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:53.751119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:53.802088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:53.808574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1ae7-c72c-416b-b883-5b90cece08f9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:53.819108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:53.830307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:53.831395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:53.831678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:53.831945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] PATH_INFO: `/v3/projects/0daacc1f04c34d8a8448e41f985c957c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:53.840229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0daacc1f04c34d8a8448e41f985c957c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:53.842570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:53.851803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 736/1491] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:53.895860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:53.897554 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:54.110951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0daacc1f04c34d8a8448e41f985c957c', 'request_id': 'req-8c92b259-7e2b-4e29-b854-83de2dc59c28'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:54.116763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dcadb-72d7-4605-9e8c-4156f45a5a5b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:54.121672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0daacc1f04c34d8a8448e41f985c957c', 'request_id': 'req-8c92b259-7e2b-4e29-b854-83de2dc59c28'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:54.135729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0daacc1f04c34d8a8448e41f985c957c', 'request_id': 'req-8c92b259-7e2b-4e29-b854-83de2dc59c28'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:54.155963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] The token cache is being invalidate because project 0daacc1f04c34d8a8448e41f985c957c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:54.156217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:54.157253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c92b259-7e2b-4e29-b854-83de2dc59c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:54.164574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 756/1492] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:53 2022] DELETE /identity/v3/projects/0daacc1f04c34d8a8448e41f985c957c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:54.166890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425408ae-d36b-410b-a674-2e9b6dfb4cd2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:54.166890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425408ae-d36b-410b-a674-2e9b6dfb4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:54.167148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425408ae-d36b-410b-a674-2e9b6dfb4cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:54.220440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-425408ae-d36b-410b-a674-2e9b6dfb4cd2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:54.221725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-425408ae-d36b-410b-a674-2e9b6dfb4cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:54.301066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:54.302410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:54.302914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:54.303381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:54.307210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:54.398640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 757/1493] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:54.417522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be2e2-9c75-4f4c-baa0-6dcc2abe5d30 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:54.417977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be2e2-9c75-4f4c-baa0-6dcc2abe5d30 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:54.418715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695be2e2-9c75-4f4c-baa0-6dcc2abe5d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:54.474445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-695be2e2-9c75-4f4c-baa0-6dcc2abe5d30 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:54.475967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-695be2e2-9c75-4f4c-baa0-6dcc2abe5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:54.486791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:54.488547 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:54.500224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 758/1494] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:54.503068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 737/1495] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:54.514251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695be2e2-9c75-4f4c-baa0-6dcc2abe5d30 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:54.555129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695be2e2-9c75-4f4c-baa0-6dcc2abe5d30 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:54.576674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:54.581056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:54.581671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:54.608328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:54.613193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:54.613643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:54.640919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:54.691925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 759/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:00:54.699872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:54.731628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eeee64-2145-4ee8-9398-535698ad4513 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:54.741704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:54.742706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:54.743187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:54.743660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:54.745720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:54.749808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:54.848763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:54.849512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 738/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:54 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:54.864594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2115a-09bd-40d9-a34a-42e4f8c6c474 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:55.013016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:55.043033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:55.043667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:55.043947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:55.044214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:55.044911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:55.053658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:55.102262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 760/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:54 2022] POST /identity/v3/users => generated 282 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:00:55.111777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:55.134348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e4c63-c3c3-425e-8bc0-999c9ca39e07 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:55.144634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:55.145700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:55.146178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:55.146715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:55.147870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:55.153710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:55.190688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:55.200786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 739/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:55.216881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d975f0-6ae1-4605-bad7-ec8819789ae0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:55.230298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fe362-25fc-40d3-a1ca-fdce9f85d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:55.231459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe362-25fc-40d3-a1ca-fdce9f85d756 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:55.232260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe362-25fc-40d3-a1ca-fdce9f85d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:55.232721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe362-25fc-40d3-a1ca-fdce9f85d756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:55.234953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fe362-25fc-40d3-a1ca-fdce9f85d756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:55.243037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fe362-25fc-40d3-a1ca-fdce9f85d756 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:55.279436 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 761/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:55.289719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:55.333290 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81274a54-316b-4641-b93f-31a2529f9e73 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:55.344531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:55.347141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:55.347772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:55.348501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] PATH_INFO: `/v3/projects/4c3728fc97f7417997fd4408dbb022c5/users/fb080f589c9142d1bbcecb12224b16af/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:55.392800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3728fc97f7417997fd4408dbb022c5, user_id=fb080f589c9142d1bbcecb12224b16af, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:55.399788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:55.417141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:55.443955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 740/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:55 2022] PUT /identity/v3/projects/4c3728fc97f7417997fd4408dbb022c5/users/fb080f589c9142d1bbcecb12224b16af/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:55.457751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64243871-bc7d-4205-8bda-55212f2d88d9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:55.458159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64243871-bc7d-4205-8bda-55212f2d88d9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:55.458504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64243871-bc7d-4205-8bda-55212f2d88d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:55.506714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-64243871-bc7d-4205-8bda-55212f2d88d9 None None] MFA Rules not processed for user `fb080f589c9142d1bbcecb12224b16af`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:55.508134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-64243871-bc7d-4205-8bda-55212f2d88d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:55.688720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 762/1502] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:55.696253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:55.854165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08e58-3316-403f-b48f-0df27bcd8f02 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:55.873875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:55.875014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:55.875511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:55.876012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:55.876944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:55.883354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:55.946875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 741/1503] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:55 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:55.950990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64243871-bc7d-4205-8bda-55212f2d88d9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:55.965413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64243871-bc7d-4205-8bda-55212f2d88d9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:56.086282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:56.087333 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:56.087790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:56.088259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:56.089159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:56.091981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:56.124088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 763/1504] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:55 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:56.128349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:56.140001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b20696-7609-466c-b146-836ab73b2487 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:56.147933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:56.148718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:56.150076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:56.150076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:56.150076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:56.152854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:56.172844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 742/1505] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:56.175226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:56.189903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dcc6a-f744-42cb-bce7-6f51f46f2745 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:56.195925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:56.196726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:56.197064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:56.197399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] PATH_INFO: `/v3/projects/de92607394ff4cf6be43a52643ada0d9/users/3f248def61da40ceb5fc812726d3158d/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:56.232135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de92607394ff4cf6be43a52643ada0d9, user_id=3f248def61da40ceb5fc812726d3158d, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:56.238307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:56.269631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 764/1506] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:56 2022] PUT /identity/v3/projects/de92607394ff4cf6be43a52643ada0d9/users/3f248def61da40ceb5fc812726d3158d/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:56.275427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:56.291740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45976e82-623b-4ac2-b017-71260d4ef8d7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:56.373139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314474b-036f-4a8d-b725-ebb0cd936970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:56.373897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314474b-036f-4a8d-b725-ebb0cd936970 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:56.374257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314474b-036f-4a8d-b725-ebb0cd936970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:56.374682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314474b-036f-4a8d-b725-ebb0cd936970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:56.375416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314474b-036f-4a8d-b725-ebb0cd936970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:56.377200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314474b-036f-4a8d-b725-ebb0cd936970 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:56.390034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 743/1507] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:56.397014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:56.417286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403fa47-2991-49f3-b640-63b5c23dbd4b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:56.456698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:56.459751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:56.460272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:56.460800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] PATH_INFO: `/v3/projects/de92607394ff4cf6be43a52643ada0d9/users/3f248def61da40ceb5fc812726d3158d/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:56.469507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de92607394ff4cf6be43a52643ada0d9, user_id=3f248def61da40ceb5fc812726d3158d, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:56.484767 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:56.516580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 765/1508] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:56 2022] PUT /identity/v3/projects/de92607394ff4cf6be43a52643ada0d9/users/3f248def61da40ceb5fc812726d3158d/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:56.522771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:56.523051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:56.523324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:56.560573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] MFA Rules not processed for user `3f248def61da40ceb5fc812726d3158d`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:56.561916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:56.684758 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:56.730994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 744/1509] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:56.755804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:56.761445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:56.786353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:56.892552 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6afdb5-0aed-4cf9-9cbb-62a8be803bc9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:56.899244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:56.900321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:56.900800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:56.901274 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:56.924563 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:56.927819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:56.951337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 766/1510] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:57.056001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:57.058024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:57.174717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ef410-c4ea-477e-a1e9-2cc8825a23f1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:57.182299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:57.183019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:57.183291 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:57.183555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] PATH_INFO: `/v3/projects/ed43d1f17bfb4d3da6951e3b7ac486bf` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:57.184774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed43d1f17bfb4d3da6951e3b7ac486bf)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:57.186851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:57.210231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:57.231549 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a42a0-dbce-47e5-b7fb-d6bad9931c31 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:57.240564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:57.241640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:57.242329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:57.242982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:57.257661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed43d1f17bfb4d3da6951e3b7ac486bf', 'request_id': 'req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:57.272194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed43d1f17bfb4d3da6951e3b7ac486bf', 'request_id': 'req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:57.291837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed43d1f17bfb4d3da6951e3b7ac486bf', 'request_id': 'req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:57.315023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] The token cache is being invalidate because project ed43d1f17bfb4d3da6951e3b7ac486bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:00:57.315602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:57.319452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-51d5e8b8-95aa-42c7-9fcd-08e0c9c55f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:57.323645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 745/1511] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:00:57 2022] DELETE /identity/v3/projects/ed43d1f17bfb4d3da6951e3b7ac486bf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:57.336852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c853-a497-4c67-933d-5399e17462ed None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:57.338440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c853-a497-4c67-933d-5399e17462ed None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:57.339166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087c853-a497-4c67-933d-5399e17462ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:57.437791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:57.443458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:57.449933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9087c853-a497-4c67-933d-5399e17462ed None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:57.452028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9087c853-a497-4c67-933d-5399e17462ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:57.476032 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 767/1512] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:00:57.632327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:57.635212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:57.642682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 746/1513] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:57.658391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428b8a-b872-49a1-b432-c343e531158a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:57.658693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428b8a-b872-49a1-b432-c343e531158a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:57.658957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428b8a-b872-49a1-b432-c343e531158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:57.705463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-04428b8a-b872-49a1-b432-c343e531158a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:57.708353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-04428b8a-b872-49a1-b432-c343e531158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:57.721121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186adf00-4778-44a1-919c-c73c71f8c260 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:57.739010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 747/1514] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:57.746008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428b8a-b872-49a1-b432-c343e531158a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:57.761520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:57.763980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:57.764545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:57.765047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] PATH_INFO: `/v3/users/efd831df7e7e4da8b6841c9406b42a9e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:57.768019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd831df7e7e4da8b6841c9406b42a9e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:57.770875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428b8a-b872-49a1-b432-c343e531158a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:57.775936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:57.776576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:57.776851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:57.777117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:57.777778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:00:57.778073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:57.778923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:57.779986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:57.812661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 748/1515] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:00:57.819783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:57.830478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:57.844786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d9bc-80f1-4fed-97c9-f47da38b425b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:57.861273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:57.861922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:57.862197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:57.862462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:57.863183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:57.865178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:57.970696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 749/1516] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:57 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:57.972048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:58.121867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd831df7e7e4da8b6841c9406b42a9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:58.123667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd831df7e7e4da8b6841c9406b42a9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:58.155375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd831df7e7e4da8b6841c9406b42a9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:58.189684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd831df7e7e4da8b6841c9406b42a9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:58.218585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ab933-a6aa-44ce-8c21-1fa53e7f6ef4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:58.239971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:58.240675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.240950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.241212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.241943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:58.244008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:58.246699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-166cbd70-91f8-43c8-a66e-987e1e096759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd831df7e7e4da8b6841c9406b42a9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:00:58.291320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 750/1517] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:57 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:00:58.295771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 768/1518] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:00:57 2022] DELETE /identity/v3/users/efd831df7e7e4da8b6841c9406b42a9e => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:58.297437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:58.299538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:58.305833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81e58-a860-4abf-bbd2-94a46210b5f2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.306150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81e58-a860-4abf-bbd2-94a46210b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.306410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81e58-a860-4abf-bbd2-94a46210b5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.331065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d241c-f90c-45d5-aa56-c300ae007ef1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:58.369026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c1c81e58-a860-4abf-bbd2-94a46210b5f2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:58.377998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c1c81e58-a860-4abf-bbd2-94a46210b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:58.415289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:58.512600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:58.513686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.515135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.515637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.517046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:58.519269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:58.533717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 751/1519] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:00:58.540446 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:58.559664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91222a-2786-4d5d-a1d4-e7fd3b8c602c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:58.567358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:58.568091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.568664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.569003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.569945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:58.570388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 769/1520] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:00:58.576105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:58.593369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 752/1521] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:00:58.601429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81e58-a860-4abf-bbd2-94a46210b5f2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:58.620456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:58.622332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:58.639430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81e58-a860-4abf-bbd2-94a46210b5f2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:58.666380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0507ca-9011-4a64-b97b-70b121c65d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:58.667461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0507ca-9011-4a64-b97b-70b121c65d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.667938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0507ca-9011-4a64-b97b-70b121c65d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.675056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0507ca-9011-4a64-b97b-70b121c65d9d admin admin] PATH_INFO: `/v3/projects/cd1e482161e84ff68b0127c22553262b/users/5853d2f4576a43d29bdd7cd90daff6ba/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.731718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0507ca-9011-4a64-b97b-70b121c65d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1e482161e84ff68b0127c22553262b, user_id=5853d2f4576a43d29bdd7cd90daff6ba, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:58.737834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0507ca-9011-4a64-b97b-70b121c65d9d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:58.760660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1ac62-4bb4-49e6-9a75-6c8e7c89c39e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:58.775317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:58.794377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 770/1522] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:58 2022] PUT /identity/v3/projects/cd1e482161e84ff68b0127c22553262b/users/5853d2f4576a43d29bdd7cd90daff6ba/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:00:58.800253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cff924-db3a-47ef-9636-28b3fa82f986 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.800815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cff924-db3a-47ef-9636-28b3fa82f986 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.801306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cff924-db3a-47ef-9636-28b3fa82f986 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.810464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 771/1523] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:00:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:00:58.830783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba170ed-9979-4916-8dcf-697da8f476ea None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.831341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba170ed-9979-4916-8dcf-697da8f476ea None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.832001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba170ed-9979-4916-8dcf-697da8f476ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.897400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:58.898060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:58.898339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:58.898761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:58.901038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5ba170ed-9979-4916-8dcf-697da8f476ea None None] MFA Rules not processed for user `5853d2f4576a43d29bdd7cd90daff6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:58.904344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5ba170ed-9979-4916-8dcf-697da8f476ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:59.089171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:59.092589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:59.121132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 772/1524] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:59.123836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2c669-95e6-43b8-8d53-28cb663efc18 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:59.124419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2c669-95e6-43b8-8d53-28cb663efc18 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:59.125058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2c669-95e6-43b8-8d53-28cb663efc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:59.127595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 753/1525] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:00:59.129269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:59.171738 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1c29f-b857-4eb8-9d4f-4da8ab91508b service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:59.180268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:59.180268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:59.180835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:59.181410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:59.182645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:59.187370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:59.191709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7ee2c669-95e6-43b8-8d53-28cb663efc18 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:59.193255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7ee2c669-95e6-43b8-8d53-28cb663efc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:59.265560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 754/1526] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:00:59 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:59.279698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:59.405800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 773/1527] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:00:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:00:59.486089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdd1a3-dbac-4191-b51b-cf76ab0a1f50 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:59.499592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:59.501352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:59.502013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:59.502705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:59.504115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:59.508545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:59.556943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 755/1528] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:00:59 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:00:59.573119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2c669-95e6-43b8-8d53-28cb663efc18 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:59.592608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2c669-95e6-43b8-8d53-28cb663efc18 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:59.600793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:59.601723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:59.602007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:59.602345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:59.603440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:59.605461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:59.622670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 774/1529] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:59.627288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:59.646998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884b013-dbd1-461b-b49f-7d2d53608ba6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:59.655104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee5332-3b28-4e9c-a323-92a796b30d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:59.655716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5332-3b28-4e9c-a323-92a796b30d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:59.656287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5332-3b28-4e9c-a323-92a796b30d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:59.656971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5332-3b28-4e9c-a323-92a796b30d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:59.658512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee5332-3b28-4e9c-a323-92a796b30d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:59.660760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee5332-3b28-4e9c-a323-92a796b30d78 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:59.683791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 756/1530] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:00:59.688207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:00:59.704275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586e716-0774-4261-8a7f-49c703e48aa7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:00:59.711337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:00:59.712846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:59.713186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:59.713864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] PATH_INFO: `/v3/projects/7bde7d55e5894be6ab58e58dd7a01070/users/025cfa7f10ad43618e2707f6ba9d4ef6/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:59.717386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:59.749703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bde7d55e5894be6ab58e58dd7a01070, user_id=025cfa7f10ad43618e2707f6ba9d4ef6, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:00:59.756722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:00:59.782583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 775/1531] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:00:59 2022] PUT /identity/v3/projects/7bde7d55e5894be6ab58e58dd7a01070/users/025cfa7f10ad43618e2707f6ba9d4ef6/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:00:59.803752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9a3c-7b32-4925-a332-445f47f5829e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:00:59.804352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9a3c-7b32-4925-a332-445f47f5829e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:00:59.805297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce9a3c-7b32-4925-a332-445f47f5829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:00:59.883767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-70ce9a3c-7b32-4925-a332-445f47f5829e None None] MFA Rules not processed for user `025cfa7f10ad43618e2707f6ba9d4ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:00:59.885531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-70ce9a3c-7b32-4925-a332-445f47f5829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:00:59.908975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:00.061286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.063606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:00.128865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 757/1532] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:00:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:00.135100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce9a3c-7b32-4925-a332-445f47f5829e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.277350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f74e88-26db-4ead-8795-d2b3f32bf89e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:00.300663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:00.301367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:00.301644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:00.301925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:00.335300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:00.337301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:00.350725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce9a3c-7b32-4925-a332-445f47f5829e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:00.367370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:00.369641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:00.370056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:00.370408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:00.373678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:00.379056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:00.386836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 776/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:00.468754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.468957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 758/1534] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:00 2022] POST /identity/v3/projects => generated 375 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:00.487384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8392a5-f98e-4c44-a67d-d0b5a9ee190e service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:00.640400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:00.641702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:00.642157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:00.642658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:00.643955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:00.646755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:00.675391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 777/1535] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:00 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:00.680085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.702328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.705744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13329b-d719-4cc0-85e1-5163207d2c5b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:00.710608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:00.715511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:00.716906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:00.717387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:00.717841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:00.720660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:00.725345 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:00.745303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d31d3e-ba4e-41ef-9c8a-a00028bc2ed3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:00.753625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 759/1536] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:00.761054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:00.762015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:00.763405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:00.763879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] PATH_INFO: `/v3/projects/1aaf190ec26d4f1588dda1ae20b2d6a9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:00.767727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.768807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aaf190ec26d4f1588dda1ae20b2d6a9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:00.771189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:00.801154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4444f-ff2a-4da5-be01-5cc7f496b382 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:00.816910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:00.817614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:00.817890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:00.818194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] PATH_INFO: `/v3/projects/9aa4e5eed39f4e5f803f8c7868285cc9/users/25db21d77544405084b10a815a0cbe01/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:00.841539 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa4e5eed39f4e5f803f8c7868285cc9, user_id=25db21d77544405084b10a815a0cbe01, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:00.854815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:00.873726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aaf190ec26d4f1588dda1ae20b2d6a9', 'request_id': 'req-a602f954-4baf-4e85-8937-d097db693c8a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:00.877662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:00.886091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 760/1537] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:00 2022] PUT /identity/v3/projects/9aa4e5eed39f4e5f803f8c7868285cc9/users/25db21d77544405084b10a815a0cbe01/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:00.886545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aaf190ec26d4f1588dda1ae20b2d6a9', 'request_id': 'req-a602f954-4baf-4e85-8937-d097db693c8a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:00.893907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.899522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aaf190ec26d4f1588dda1ae20b2d6a9', 'request_id': 'req-a602f954-4baf-4e85-8937-d097db693c8a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:00.927161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] The token cache is being invalidate because project 1aaf190ec26d4f1588dda1ae20b2d6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:00.927680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:00.929058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:00.932046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 778/1538] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:00 2022] DELETE /identity/v3/projects/1aaf190ec26d4f1588dda1ae20b2d6a9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:00.936970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:00.939710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:01.019588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ec7a7-c901-46ce-95b3-1ba51559f5a2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:01.028328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:01.029490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:01.029868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:01.030329 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:01.031775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:01.036673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:01.037641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:01.066062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 761/1539] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:01.067676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:01.071597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:01.083807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602f954-4baf-4e85-8937-d097db693c8a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:01.089306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:01.090240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:01.090520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:01.090842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] PATH_INFO: `/v3/users/e7dad742f510480eb237ed5b4c4a9e2a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:01.092740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7dad742f510480eb237ed5b4c4a9e2a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:01.095021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:01.104573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb7f13-f8df-4a35-9f89-9bbd6adf0a42 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:01.115340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548d605-7333-4449-89d8-375b72bbef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:01.118022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548d605-7333-4449-89d8-375b72bbef76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:01.119304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548d605-7333-4449-89d8-375b72bbef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:01.119766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548d605-7333-4449-89d8-375b72bbef76 admin admin] PATH_INFO: `/v3/projects/9aa4e5eed39f4e5f803f8c7868285cc9/users/25db21d77544405084b10a815a0cbe01/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:01.124941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548d605-7333-4449-89d8-375b72bbef76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa4e5eed39f4e5f803f8c7868285cc9, user_id=25db21d77544405084b10a815a0cbe01, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:01.130467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548d605-7333-4449-89d8-375b72bbef76 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:01.154883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 762/1540] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:01 2022] PUT /identity/v3/projects/9aa4e5eed39f4e5f803f8c7868285cc9/users/25db21d77544405084b10a815a0cbe01/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:01.172864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:01.173286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:01.173609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:01.185732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7dad742f510480eb237ed5b4c4a9e2a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:01.186519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7dad742f510480eb237ed5b4c4a9e2a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:01.198873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7dad742f510480eb237ed5b4c4a9e2a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:01.217633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7dad742f510480eb237ed5b4c4a9e2a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:01.238150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] MFA Rules not processed for user `25db21d77544405084b10a815a0cbe01`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:01.240857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7dad742f510480eb237ed5b4c4a9e2a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:01.245666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:01.251806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 779/1541] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:00 2022] DELETE /identity/v3/users/e7dad742f510480eb237ed5b4c4a9e2a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:01.475143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 763/1542] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:01.487980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:01.489840 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:01.596716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a899fe-d676-4f6c-b3c4-a31c5d188346 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:01.602340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:01.603132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:01.603409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:01.603724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:01.606351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:01.625992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:01.715182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:01.716913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:01.740326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 780/1543] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:02.239135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:02.242437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:02.498060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50168-209d-4335-b4f0-93bff5219d62 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:02.623309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:02.624932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:02.625511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:02.626061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] PATH_INFO: `/v3/projects/e38f5faf63004a8eb32afa09c2f5dde0` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:02.633364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38f5faf63004a8eb32afa09c2f5dde0)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:02.638732 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:02.666186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:02.773868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38f5faf63004a8eb32afa09c2f5dde0', 'request_id': 'req-b397753a-b919-4a19-878c-d4da4644c43d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:02.786485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38f5faf63004a8eb32afa09c2f5dde0', 'request_id': 'req-b397753a-b919-4a19-878c-d4da4644c43d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:02.807621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38f5faf63004a8eb32afa09c2f5dde0', 'request_id': 'req-b397753a-b919-4a19-878c-d4da4644c43d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:02.856823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] The token cache is being invalidate because project e38f5faf63004a8eb32afa09c2f5dde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:02.857846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:02.859505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:02.869586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 764/1544] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:02 2022] DELETE /identity/v3/projects/e38f5faf63004a8eb32afa09c2f5dde0 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:02.870745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:02.888665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7157a96-483d-4cdf-b62d-5a3a8784085a service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:03.103439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:03.105366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:03.108239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:03.110783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] PATH_INFO: `/v3/users/885e12e8829f43858f5a1d81443700c3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:03.112831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885e12e8829f43858f5a1d81443700c3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:03.116254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:03.248324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885e12e8829f43858f5a1d81443700c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:03.249353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885e12e8829f43858f5a1d81443700c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:03.274133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885e12e8829f43858f5a1d81443700c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:03.291750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885e12e8829f43858f5a1d81443700c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:03.356436 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885e12e8829f43858f5a1d81443700c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:03.364533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 781/1545] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:02 2022] DELETE /identity/v3/users/885e12e8829f43858f5a1d81443700c3 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:03.824733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:03.828838 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:03.893663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:03.897165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:03.913311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397753a-b919-4a19-878c-d4da4644c43d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:04.009847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd8db7-5421-4a6d-b6c1-d844f52615bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:04.010399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd8db7-5421-4a6d-b6c1-d844f52615bb service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:04.010701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd8db7-5421-4a6d-b6c1-d844f52615bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:04.010967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd8db7-5421-4a6d-b6c1-d844f52615bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:04.013503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a2bd8db7-5421-4a6d-b6c1-d844f52615bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:04.017868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:04.102375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89086d-5cc4-4ebd-81e1-3423e46ac871 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:04.110891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:04.112246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:04.112907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:04.113355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] PATH_INFO: `/v3/projects/6596031564664b87b244eee87694a77d` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:04.115258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6596031564664b87b244eee87694a77d)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:04.120167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:04.170705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd8db7-5421-4a6d-b6c1-d844f52615bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:04.172304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd8db7-5421-4a6d-b6c1-d844f52615bb service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:04.183330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 765/1546] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:04.209453 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6596031564664b87b244eee87694a77d', 'request_id': 'req-da327f10-1277-4fac-9f28-7923957c8533'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:04.221097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6596031564664b87b244eee87694a77d', 'request_id': 'req-da327f10-1277-4fac-9f28-7923957c8533'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:04.233708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6596031564664b87b244eee87694a77d', 'request_id': 'req-da327f10-1277-4fac-9f28-7923957c8533'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:04.256175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] The token cache is being invalidate because project 6596031564664b87b244eee87694a77d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:04.256567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:04.257338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-da327f10-1277-4fac-9f28-7923957c8533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:04.262689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 782/1547] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:03 2022] DELETE /identity/v3/projects/6596031564664b87b244eee87694a77d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:04.266235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe6de-fc10-434a-835d-6a6b88840344 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:04.266786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe6de-fc10-434a-835d-6a6b88840344 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:04.267297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbe6de-fc10-434a-835d-6a6b88840344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:04.303270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0ffbe6de-fc10-434a-835d-6a6b88840344 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:04.304551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0ffbe6de-fc10-434a-835d-6a6b88840344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:04.320802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:04.397885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 766/1548] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:04.408429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2971-5d50-40f1-a822-3fb5d05fecfb None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:04.409005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2971-5d50-40f1-a822-3fb5d05fecfb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:04.409363 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2971-5d50-40f1-a822-3fb5d05fecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:04.449918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-227f2971-5d50-40f1-a822-3fb5d05fecfb None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:04.451830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-227f2971-5d50-40f1-a822-3fb5d05fecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:04.465054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 783/1549] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:04.469466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbe6de-fc10-434a-835d-6a6b88840344 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:04.506936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbe6de-fc10-434a-835d-6a6b88840344 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:04.514087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:04.515173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:04.515575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:04.516022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:04.517821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:04.518450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:04.520372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:04.558902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 767/1550] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:04.563906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2971-5d50-40f1-a822-3fb5d05fecfb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:04.578051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2971-5d50-40f1-a822-3fb5d05fecfb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:04.591479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:04.592680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:04.596071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:04.596479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:04.598298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:04.618342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:04.781727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 784/1551] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:04 2022] POST /identity/v3/projects => generated 401 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:04.786929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:04.809667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c9eb-0e68-43a4-bca8-9626455ee9e0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:04.920316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:04.922280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:04.923070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:04.923505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:04.924252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:04.927178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:04.977816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 768/1552] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:04 2022] POST /identity/v3/users => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:04.979973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:04.996747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d578f-4413-4ffb-a70b-ba8cd2c9a35a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:05.005094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:05.005884 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:05.006227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:05.006409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:05.007134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:05.009579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:05.031656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 785/1553] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:05.036586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:05.059053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4085-2b38-4906-921b-ef4470d53678 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:05.066722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b89ba6-07c9-4ef9-b68e-8bfd95868348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:05.067745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89ba6-07c9-4ef9-b68e-8bfd95868348 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:05.068180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89ba6-07c9-4ef9-b68e-8bfd95868348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:05.068902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b89ba6-07c9-4ef9-b68e-8bfd95868348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:05.069871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b89ba6-07c9-4ef9-b68e-8bfd95868348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:05.072604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b89ba6-07c9-4ef9-b68e-8bfd95868348 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:05.135817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 769/1554] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:05.135995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:05.151942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f20d2-0040-4c22-833d-ff1364911659 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:05.167847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:05.168635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:05.168909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:05.169215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] PATH_INFO: `/v3/projects/c77b7ad48f924f328ad31136355e4789/users/5007a2975f80465f8850ca8420d2335d/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:05.226458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77b7ad48f924f328ad31136355e4789, user_id=5007a2975f80465f8850ca8420d2335d, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:05.232284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:05.270998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 786/1555] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:05 2022] PUT /identity/v3/projects/c77b7ad48f924f328ad31136355e4789/users/5007a2975f80465f8850ca8420d2335d/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:05.283525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dd64-3c25-4226-857d-7f9c93f55d5d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:05.283525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dd64-3c25-4226-857d-7f9c93f55d5d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:05.283915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dd64-3c25-4226-857d-7f9c93f55d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:05.348683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-da15dd64-3c25-4226-857d-7f9c93f55d5d None None] MFA Rules not processed for user `5007a2975f80465f8850ca8420d2335d`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:05.351285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-da15dd64-3c25-4226-857d-7f9c93f55d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:05.498387 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:05.501391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:05.553932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 770/1556] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:05.560278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dd64-3c25-4226-857d-7f9c93f55d5d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:05.582111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:05.654724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e548f4-3e3d-4021-81c1-2e9f96330a24 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:05.659351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:05.660328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:05.661187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:05.661624 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:05.664125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:05.670345 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dd64-3c25-4226-857d-7f9c93f55d5d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:05.678789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:05.680362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:05.680839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:05.681340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:05.682662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:05.686543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:05.688034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:05.739869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 771/1557] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:05 2022] POST /identity/v3/projects => generated 399 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:05.745285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:05.755814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:05.757944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:05.772467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 787/1558] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:05.855973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604d8d5-78d2-403d-9479-924d70dafc29 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:05.863627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:05.864600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:05.864934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:05.865154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:05.866479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:05.881882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:05.938759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 772/1559] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:05 2022] POST /identity/v3/users => generated 306 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:05.940663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:05.978885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223b93-5071-4262-94d7-6ca67fd1712a service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:06.015283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:06.016958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:06.017698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:06.018378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:06.021500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:06.024621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:06.064203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 788/1560] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:06.065706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:06.099476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633808be-681f-4b20-9892-24cb3605fdc7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:06.104895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:06.106079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:06.106079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:06.106386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] PATH_INFO: `/v3/projects/75cbaeac9206404eb5700080481541de/users/32bf5c096ba34ec2bc10b5ed65323dcb/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:06.145340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cbaeac9206404eb5700080481541de, user_id=32bf5c096ba34ec2bc10b5ed65323dcb, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:06.156140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:06.188841 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 773/1561] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:06 2022] PUT /identity/v3/projects/75cbaeac9206404eb5700080481541de/users/32bf5c096ba34ec2bc10b5ed65323dcb/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:06.191415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:06.228761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e446185-f304-467d-b9ae-e7f03b22ce4a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:06.382649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:06.384808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:06.385344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:06.386759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:06.388273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:06.393316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:06.423199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 789/1562] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:06.427683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:06.459206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18ef16-5455-4f52-8151-5e2c75078aed admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:06.475532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d0288-cb5c-46bc-9a83-787ebac73779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:06.484600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0288-cb5c-46bc-9a83-787ebac73779 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:06.491055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0288-cb5c-46bc-9a83-787ebac73779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:06.491417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d0288-cb5c-46bc-9a83-787ebac73779 admin admin] PATH_INFO: `/v3/projects/75cbaeac9206404eb5700080481541de/users/32bf5c096ba34ec2bc10b5ed65323dcb/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:06.496962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d0288-cb5c-46bc-9a83-787ebac73779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cbaeac9206404eb5700080481541de, user_id=32bf5c096ba34ec2bc10b5ed65323dcb, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:06.499588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d0288-cb5c-46bc-9a83-787ebac73779 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:06.529749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:06.532216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:06.562667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a61d7-536c-4af1-9f34-fa86abdc23ce admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:06.562962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 774/1563] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:06 2022] PUT /identity/v3/projects/75cbaeac9206404eb5700080481541de/users/32bf5c096ba34ec2bc10b5ed65323dcb/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:06.564888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad737a-b19b-4231-982a-a6a1d44119e9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:06.564888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad737a-b19b-4231-982a-a6a1d44119e9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:06.565144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad737a-b19b-4231-982a-a6a1d44119e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:06.653719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-55ad737a-b19b-4231-982a-a6a1d44119e9 None None] MFA Rules not processed for user `32bf5c096ba34ec2bc10b5ed65323dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:06.656590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-55ad737a-b19b-4231-982a-a6a1d44119e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:06.772028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:06.772765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:06.773105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:06.774057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:06.774490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] PATH_INFO: `/v3/users/fb080f589c9142d1bbcecb12224b16af` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:06.776187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb080f589c9142d1bbcecb12224b16af)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:06.782465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:06.855106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:06.867682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb080f589c9142d1bbcecb12224b16af'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:06.867942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb080f589c9142d1bbcecb12224b16af'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:06.878093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb080f589c9142d1bbcecb12224b16af'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:06.881053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 775/1564] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:06.889336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb080f589c9142d1bbcecb12224b16af'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:06.914443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad737a-b19b-4231-982a-a6a1d44119e9 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:06.930856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8c7b8614-ad3f-48e6-9485-3b6afafd7387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb080f589c9142d1bbcecb12224b16af'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:06.941748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 790/1565] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:06 2022] DELETE /identity/v3/users/fb080f589c9142d1bbcecb12224b16af => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:06.948429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:06.949037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:06.949532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:06.980293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:06.982026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:07.012808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad737a-b19b-4231-982a-a6a1d44119e9 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:07.096495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 791/1566] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:07.105386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:07.108145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:07.128808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:07.129452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:07.129732 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:07.129997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:07.132431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:07.255153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7c73e-c0a6-4a87-8117-b6ab9cc65781 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:07.263648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:07.265197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:07.265865 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:07.266504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:07.282090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:07.286035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:07.290777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:07.294703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:07.305867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 776/1567] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:07.313604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 792/1568] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:07.436716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:07.439656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:07.466481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1864832-8a63-475c-b1b1-88ef51786ff9 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:07.474494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:07.475504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:07.475805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:07.476024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:07.488946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:07.567254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:07.607814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:07.614780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:07.639932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 777/1569] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:07 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:07.862949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:07.864650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:07.882681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c8195-47e9-4576-b65f-8344bd870a3c service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:07.890283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:07.892457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:07.892457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:07.892457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] PATH_INFO: `/v3/projects/4c3728fc97f7417997fd4408dbb022c5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:07.894083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3728fc97f7417997fd4408dbb022c5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:07.896167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:08.004005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3728fc97f7417997fd4408dbb022c5', 'request_id': 'req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.009242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:08.015894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3728fc97f7417997fd4408dbb022c5', 'request_id': 'req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.028276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3728fc97f7417997fd4408dbb022c5', 'request_id': 'req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.046124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] The token cache is being invalidate because project 4c3728fc97f7417997fd4408dbb022c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:08.046418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.047184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.048850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 793/1570] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:07 2022] DELETE /identity/v3/projects/4c3728fc97f7417997fd4408dbb022c5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:08.053066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:08.066546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d0379-5507-48dd-b80e-1034aa4d534b service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:08.159186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:08.160039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:08.160421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:08.160971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] PATH_INFO: `/v3/users/3f248def61da40ceb5fc812726d3158d` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:08.162612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f248def61da40ceb5fc812726d3158d)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:08.165988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:08.235707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f248def61da40ceb5fc812726d3158d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.236758 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f248def61da40ceb5fc812726d3158d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.254270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f248def61da40ceb5fc812726d3158d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.264335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f248def61da40ceb5fc812726d3158d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.265511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4352ef96-5c31-4f58-8398-c799a64d17c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f248def61da40ceb5fc812726d3158d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:08.284063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 778/1571] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:08 2022] DELETE /identity/v3/users/3f248def61da40ceb5fc812726d3158d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:08.994877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:08.998329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:09.041091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bcb97-f1e4-4c88-9606-872d79f8d7c3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:09.233366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:09.234379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:09.235161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:09.235828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] PATH_INFO: `/v3/projects/de92607394ff4cf6be43a52643ada0d9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:09.238607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de92607394ff4cf6be43a52643ada0d9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:09.245500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:09.357290 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de92607394ff4cf6be43a52643ada0d9', 'request_id': 'req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:09.371949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de92607394ff4cf6be43a52643ada0d9', 'request_id': 'req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:09.391320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de92607394ff4cf6be43a52643ada0d9', 'request_id': 'req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:09.410002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] The token cache is being invalidate because project de92607394ff4cf6be43a52643ada0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:09.410736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:09.412590 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e9f2646-28ed-40c4-9cd8-d927cfd57c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:09.416691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 794/1572] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:08 2022] DELETE /identity/v3/projects/de92607394ff4cf6be43a52643ada0d9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:09.423900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2193-0356-44f0-883e-f30e05d595f8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:09.425548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2193-0356-44f0-883e-f30e05d595f8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:09.426066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d2193-0356-44f0-883e-f30e05d595f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:09.465567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0f3d2193-0356-44f0-883e-f30e05d595f8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:09.468703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0f3d2193-0356-44f0-883e-f30e05d595f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:09.628113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:09.657624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 779/1573] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:09.666242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b79f-8b52-4661-bf35-e16b883d7881 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:09.667054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b79f-8b52-4661-bf35-e16b883d7881 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:09.667338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4b79f-8b52-4661-bf35-e16b883d7881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:09.725559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d6b4b79f-8b52-4661-bf35-e16b883d7881 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:09.728409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d6b4b79f-8b52-4661-bf35-e16b883d7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:09.751123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 795/1574] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:09.753242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2193-0356-44f0-883e-f30e05d595f8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:09.774010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d2193-0356-44f0-883e-f30e05d595f8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:09.796070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:09.797411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:09.798109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:09.798588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:09.799757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:09.800431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:09.804357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:09.841855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 780/1575] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:01:09.847712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4b79f-8b52-4661-bf35-e16b883d7881 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:09.863189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4b79f-8b52-4661-bf35-e16b883d7881 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:09.870672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:09.872290 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:09.873048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:09.873466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:09.874769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:09.877141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:09.925519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 796/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:09 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:09.927209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:09.945677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ffd38-3e7b-4939-a238-5b81135864eb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:10.090623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:10.091318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.091596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:10.091898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:10.092629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:10.094680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:10.128492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 781/1577] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:09 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:10.135025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:10.149046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61332819-aa05-4b32-a2f9-0d23890f9952 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:10.154645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:10.155391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.155730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:10.156211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:10.156957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:10.158771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:10.171848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 797/1578] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:10.176509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:10.189110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa1b65-bddf-40eb-ae49-cd5d673677d8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:10.195589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fbb45-8d5f-4de7-8d00-3b663133b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:10.196994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fbb45-8d5f-4de7-8d00-3b663133b2ce admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.196994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fbb45-8d5f-4de7-8d00-3b663133b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:10.196994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fbb45-8d5f-4de7-8d00-3b663133b2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:10.197716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fbb45-8d5f-4de7-8d00-3b663133b2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:10.199561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fbb45-8d5f-4de7-8d00-3b663133b2ce admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:10.214658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 782/1579] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:10.218516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:10.229826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28737d90-59dd-4752-9544-50df4888c7c1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:10.236012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:10.237223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.237689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:10.238364 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] PATH_INFO: `/v3/projects/a75bfc8426184300a1ac1314a9540e21/users/101130a7b91d406c9b0d088f344e05cf/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:10.277762 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75bfc8426184300a1ac1314a9540e21, user_id=101130a7b91d406c9b0d088f344e05cf, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:10.284654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:10.312562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 798/1580] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:10 2022] PUT /identity/v3/projects/a75bfc8426184300a1ac1314a9540e21/users/101130a7b91d406c9b0d088f344e05cf/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:10.324868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.325372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:10.325673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:10.370175 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] MFA Rules not processed for user `101130a7b91d406c9b0d088f344e05cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:10.371485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:10.526684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 783/1581] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:10.530718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:10.570370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:10.591401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:10.594137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:10.751778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d876822-79b0-4f88-9c56-03db37cb289c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:10.765299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:10.765941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.766217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:10.766483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:10.767190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:10.769179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:10.792790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:10.818478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 799/1582] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:10 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:10.821689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:10.830633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126347e2-4aaf-45d9-a0be-aadc375895cc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:10.928022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a580c-88fc-4f95-b3f6-c495dbb24a86 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:10.936872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:10.937774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.938233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:10.938713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:10.939651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:10.942151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:10.989059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 800/1583] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:10 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:10.992427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:10.993635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:10.995373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:10.996077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.003095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] PATH_INFO: `/v3/users/5853d2f4576a43d29bdd7cd90daff6ba` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.005989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5853d2f4576a43d29bdd7cd90daff6ba)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:11.009089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:11.017062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4c669-f152-4ea7-9f09-6c7468263529 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:11.027651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:11.029120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:11.029639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.030129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.032130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:11.035468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:11.062642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 801/1584] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:11.069374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:11.100091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5b29a-a7e1-4b19-8fb3-9cac72c386ea admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:11.107731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:11.108774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:11.109216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.109693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] PATH_INFO: `/v3/projects/746e8ba09b314f50887689a11157653d/users/e3ecc55f0c23463d9df10ea9443b4789/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.118416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5853d2f4576a43d29bdd7cd90daff6ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:11.119591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5853d2f4576a43d29bdd7cd90daff6ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:11.143369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746e8ba09b314f50887689a11157653d, user_id=e3ecc55f0c23463d9df10ea9443b4789, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:11.149777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:11.151991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5853d2f4576a43d29bdd7cd90daff6ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:11.168461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5853d2f4576a43d29bdd7cd90daff6ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:11.169809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-93c7188a-8f14-4642-92e6-d1e87557e722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5853d2f4576a43d29bdd7cd90daff6ba'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:11.202267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 802/1585] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:11 2022] PUT /identity/v3/projects/746e8ba09b314f50887689a11157653d/users/e3ecc55f0c23463d9df10ea9443b4789/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:11.209844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:11.215817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:11.227033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 784/1586] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:10 2022] DELETE /identity/v3/users/5853d2f4576a43d29bdd7cd90daff6ba => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:11.233282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:11.233410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.233643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.317118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:11.320590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:11.338076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:11.390940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea0b5a-10a3-49ae-8732-9eaa670c2847 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:11.492416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 785/1587] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:11.553849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:11.563863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:11.566324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:11.567011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:11.567390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.567792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.568413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:11.570136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:11.605004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 803/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:11.607311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:11.649403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5c55f-bc18-434a-a4df-ec96d4b24145 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:11.672345 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:11.683046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d99c3-2bc9-48cf-bffd-79bc6f505d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:11.686321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d99c3-2bc9-48cf-bffd-79bc6f505d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:11.687133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d99c3-2bc9-48cf-bffd-79bc6f505d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.687635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d99c3-2bc9-48cf-bffd-79bc6f505d9c admin admin] PATH_INFO: `/v3/projects/746e8ba09b314f50887689a11157653d/users/e3ecc55f0c23463d9df10ea9443b4789/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.691145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d99c3-2bc9-48cf-bffd-79bc6f505d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=746e8ba09b314f50887689a11157653d, user_id=e3ecc55f0c23463d9df10ea9443b4789, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:11.698310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d99c3-2bc9-48cf-bffd-79bc6f505d9c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:11.726402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 804/1589] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:11 2022] PUT /identity/v3/projects/746e8ba09b314f50887689a11157653d/users/e3ecc55f0c23463d9df10ea9443b4789/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:11.740400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:11.741502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.741502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.773494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65510d-cc5a-4b11-a69a-f34b8b5c53ea None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:11.805045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] MFA Rules not processed for user `e3ecc55f0c23463d9df10ea9443b4789`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:11.807966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:11.948269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:11.948269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:11.948269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:11.948269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:11.960412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 805/1590] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:12.018313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:12.020055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:12.151272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49f3e-9713-4d14-a9c6-721ec963e908 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:12.158354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d4ba-3726-4c79-8681-6847ed3b9e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:12.159642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:12.159841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d4ba-3726-4c79-8681-6847ed3b9e12 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:12.160418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d4ba-3726-4c79-8681-6847ed3b9e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:12.161016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d4ba-3726-4c79-8681-6847ed3b9e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:12.163082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:12.164941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b489d4ba-3726-4c79-8681-6847ed3b9e12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:12.192548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 786/1591] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:12.194430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:12.286861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d4ba-3726-4c79-8681-6847ed3b9e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:12.290088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489d4ba-3726-4c79-8681-6847ed3b9e12 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:12.308960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 806/1592] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:13.136946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:13.141194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:13.166759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307f48-1737-4b2a-956c-1f775742e9a7 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:13.187700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:13.190277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:13.193976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:13.195204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] PATH_INFO: `/v3/users/5007a2975f80465f8850ca8420d2335d` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:13.202083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5007a2975f80465f8850ca8420d2335d)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:13.212941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:13.479397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5007a2975f80465f8850ca8420d2335d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:13.483784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5007a2975f80465f8850ca8420d2335d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:13.532582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5007a2975f80465f8850ca8420d2335d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:13.553438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5007a2975f80465f8850ca8420d2335d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:13.556473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5007a2975f80465f8850ca8420d2335d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:13.579630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:13.593312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:13.593813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:13.594233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:13.595860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 787/1593] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:13 2022] DELETE /identity/v3/users/5007a2975f80465f8850ca8420d2335d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:13.654990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:13.657688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:13.784871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:13.786449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:13.841793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 807/1594] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:13.871359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:13.874418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:13.950928 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39b48e-5ba4-4e84-a62c-242a9dd9268b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:13.984620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:13.985617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:13.993180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:13.993721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] PATH_INFO: `/v3/projects/cd1e482161e84ff68b0127c22553262b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:13.996761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1e482161e84ff68b0127c22553262b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:14.015486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:14.111960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25301b3-9363-4de9-afd6-b2d654c6eb81 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:14.129457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:14.130101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:14.130371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:14.130662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:14.220410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:14.227739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:14.247008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1e482161e84ff68b0127c22553262b', 'request_id': 'req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.263807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1e482161e84ff68b0127c22553262b', 'request_id': 'req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.270619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 808/1595] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:14.277863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1e482161e84ff68b0127c22553262b', 'request_id': 'req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.297065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] The token cache is being invalidate because project cd1e482161e84ff68b0127c22553262b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:14.297623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.299404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.303635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 788/1596] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:13 2022] DELETE /identity/v3/projects/cd1e482161e84ff68b0127c22553262b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:14.308685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:14.324557 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f1222-a111-4b66-b357-6d7d066a9414 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:14.501110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:14.502627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:14.503242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:14.503834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] PATH_INFO: `/v3/users/025cfa7f10ad43618e2707f6ba9d4ef6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:14.506713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025cfa7f10ad43618e2707f6ba9d4ef6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:14.511138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:14.520583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:14.677461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025cfa7f10ad43618e2707f6ba9d4ef6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.687355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025cfa7f10ad43618e2707f6ba9d4ef6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.710207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025cfa7f10ad43618e2707f6ba9d4ef6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.732103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025cfa7f10ad43618e2707f6ba9d4ef6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.775051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025cfa7f10ad43618e2707f6ba9d4ef6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:14.791617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 809/1597] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:14 2022] DELETE /identity/v3/users/025cfa7f10ad43618e2707f6ba9d4ef6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:15.516273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:15.517828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:15.580571 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee627-8c2d-49e4-9f03-db5ca4a84ee0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:15.750314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:15.752230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:15.782064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:15.782917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:15.783247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:15.783572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] PATH_INFO: `/v3/projects/7bde7d55e5894be6ab58e58dd7a01070` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:15.787669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bde7d55e5894be6ab58e58dd7a01070)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:15.795107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:15.896226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf75b4f-1c2d-420d-b5da-0ed6aebabc09 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:15.904188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:15.906423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:15.907228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:15.908082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:15.912194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:15.915512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:15.962524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bde7d55e5894be6ab58e58dd7a01070', 'request_id': 'req-2d2e76ea-6a67-495f-9e13-78030bad0738'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:15.984238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bde7d55e5894be6ab58e58dd7a01070', 'request_id': 'req-2d2e76ea-6a67-495f-9e13-78030bad0738'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.004085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bde7d55e5894be6ab58e58dd7a01070', 'request_id': 'req-2d2e76ea-6a67-495f-9e13-78030bad0738'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.026814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] The token cache is being invalidate because project 7bde7d55e5894be6ab58e58dd7a01070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:16.027115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.027869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.032652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 789/1598] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:15 2022] DELETE /identity/v3/projects/7bde7d55e5894be6ab58e58dd7a01070 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:16.033907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:16.036204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:16.051188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:16.052998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:16.069021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 810/1599] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:16.070030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:16.072697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:16.115246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1008e4f-2d88-44db-b32c-759dc14e2747 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:16.178543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e76ea-6a67-495f-9e13-78030bad0738 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:16.180254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:16.197479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:16.198279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:16.199915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:16.200368 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] PATH_INFO: `/v3/projects/c77b7ad48f924f328ad31136355e4789` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:16.201780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77b7ad48f924f328ad31136355e4789)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:16.209795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:16.255183 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:16.256132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:16.256615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:16.256965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] PATH_INFO: `/v3/users/25db21d77544405084b10a815a0cbe01` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:16.258508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25db21d77544405084b10a815a0cbe01)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:16.263539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:16.321761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77b7ad48f924f328ad31136355e4789', 'request_id': 'req-4271d6f1-02f3-4b67-887c-80fdc79b9681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.331094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77b7ad48f924f328ad31136355e4789', 'request_id': 'req-4271d6f1-02f3-4b67-887c-80fdc79b9681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.348106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77b7ad48f924f328ad31136355e4789', 'request_id': 'req-4271d6f1-02f3-4b67-887c-80fdc79b9681'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.376058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25db21d77544405084b10a815a0cbe01'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.376452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25db21d77544405084b10a815a0cbe01'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.389337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] The token cache is being invalidate because project c77b7ad48f924f328ad31136355e4789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:16.389645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.392468 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.396615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25db21d77544405084b10a815a0cbe01'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.400078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 790/1600] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:16 2022] DELETE /identity/v3/projects/c77b7ad48f924f328ad31136355e4789 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:16.407632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:16.410005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:16.414382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25db21d77544405084b10a815a0cbe01'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.465003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25db21d77544405084b10a815a0cbe01'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.490383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 811/1601] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:16 2022] DELETE /identity/v3/users/25db21d77544405084b10a815a0cbe01 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:16.507040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:16.554045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271d6f1-02f3-4b67-887c-80fdc79b9681 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:16.795459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:16.796402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:16.796402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:16.796740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] PATH_INFO: `/v3/users/32bf5c096ba34ec2bc10b5ed65323dcb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:16.803537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bf5c096ba34ec2bc10b5ed65323dcb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:16.805600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:16.937779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bf5c096ba34ec2bc10b5ed65323dcb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.938541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bf5c096ba34ec2bc10b5ed65323dcb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.965256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bf5c096ba34ec2bc10b5ed65323dcb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.995660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bf5c096ba34ec2bc10b5ed65323dcb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:16.996430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9986fb16-4bba-4fc0-8bbf-b5e1e6daa15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bf5c096ba34ec2bc10b5ed65323dcb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:17.032859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 791/1602] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:16 2022] DELETE /identity/v3/users/32bf5c096ba34ec2bc10b5ed65323dcb => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:18.607315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:18.610388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:18.667490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365b30-0c7e-4474-9829-8c50cfc1b369 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:18.779073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:18.779699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:18.779979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:18.780250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] PATH_INFO: `/v3/projects/9aa4e5eed39f4e5f803f8c7868285cc9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:18.781778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa4e5eed39f4e5f803f8c7868285cc9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:18.783934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:18.896326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa4e5eed39f4e5f803f8c7868285cc9', 'request_id': 'req-cdb8f504-2a79-4014-9c03-5d51e5c9b144'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:18.899725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:18.908653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa4e5eed39f4e5f803f8c7868285cc9', 'request_id': 'req-cdb8f504-2a79-4014-9c03-5d51e5c9b144'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:18.920494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa4e5eed39f4e5f803f8c7868285cc9', 'request_id': 'req-cdb8f504-2a79-4014-9c03-5d51e5c9b144'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:18.940808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] The token cache is being invalidate because project 9aa4e5eed39f4e5f803f8c7868285cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:18.941307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:18.942385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:18.946634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 812/1603] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:18 2022] DELETE /identity/v3/projects/9aa4e5eed39f4e5f803f8c7868285cc9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:18.957060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44964eae-a0c2-4050-ba67-76ea335b566f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:18.957752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44964eae-a0c2-4050-ba67-76ea335b566f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:18.957752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44964eae-a0c2-4050-ba67-76ea335b566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:18.994664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-44964eae-a0c2-4050-ba67-76ea335b566f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:19.000933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-44964eae-a0c2-4050-ba67-76ea335b566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:19.155413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 792/1604] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:19.166317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.168535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:19.172223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972d77c-c268-41a8-9868-3996deb2dfd1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.172827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972d77c-c268-41a8-9868-3996deb2dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.173391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972d77c-c268-41a8-9868-3996deb2dfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.191619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f504-2a79-4014-9c03-5d51e5c9b144 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.212740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.216147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.216147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.216147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] PATH_INFO: `/v3/projects/75cbaeac9206404eb5700080481541de` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.217352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cbaeac9206404eb5700080481541de)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.219610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.233162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3972d77c-c268-41a8-9868-3996deb2dfd1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:19.234414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3972d77c-c268-41a8-9868-3996deb2dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:19.278934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 793/1605] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:19.280792 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972d77c-c268-41a8-9868-3996deb2dfd1 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.318706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972d77c-c268-41a8-9868-3996deb2dfd1 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.324709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:19.335992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cbaeac9206404eb5700080481541de', 'request_id': 'req-975814c1-4fe3-4899-aab3-d402849cd9fb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:19.350470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cbaeac9206404eb5700080481541de', 'request_id': 'req-975814c1-4fe3-4899-aab3-d402849cd9fb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:19.369579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cbaeac9206404eb5700080481541de', 'request_id': 'req-975814c1-4fe3-4899-aab3-d402849cd9fb'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:19.408311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.408799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] The token cache is being invalidate because project 75cbaeac9206404eb5700080481541de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:19.409225 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.409335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:19.409670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.410037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.410948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:19.411353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.415158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.417296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-975814c1-4fe3-4899-aab3-d402849cd9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:19.423755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 813/1606] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:19 2022] DELETE /identity/v3/projects/75cbaeac9206404eb5700080481541de => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:19.427660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7b846-6087-4830-af2f-0defc4225f67 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.428111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7b846-6087-4830-af2f-0defc4225f67 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.429555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7b846-6087-4830-af2f-0defc4225f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.433009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 794/1607] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:19.439394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.441894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:19.477577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7df7b846-6087-4830-af2f-0defc4225f67 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:19.480078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7df7b846-6087-4830-af2f-0defc4225f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:19.501824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf9462-5e17-4087-90a9-b04c3eb4d180 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.507504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.508649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.508649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.508649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.509308 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.511779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.514976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 814/1608] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:19.526385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47597-9bcb-48d4-aadd-ca6192674fff None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.526709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47597-9bcb-48d4-aadd-ca6192674fff None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.526978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47597-9bcb-48d4-aadd-ca6192674fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.555112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 795/1609] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:19.566108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.571003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-44d47597-9bcb-48d4-aadd-ca6192674fff None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:19.573236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-44d47597-9bcb-48d4-aadd-ca6192674fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:19.677161 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bed0a1-ec11-4187-ba2c-6e1276df0863 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.683917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.685524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.686080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.686627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.687638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.689832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.732130 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 796/1610] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:19.733297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.739491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 815/1611] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:19.742297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d47597-9bcb-48d4-aadd-ca6192674fff None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.745495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d287-0976-4afd-a691-c204587b29d2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.752279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.752944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.753222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.753517 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.754214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.756377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.759411 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d47597-9bcb-48d4-aadd-ca6192674fff None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.767450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.768499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.770592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 797/1612] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:19.770731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.770731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.770890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:19.771301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.774487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.774674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.786870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce630c-08fc-4d1d-8120-d50847bb6906 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.796157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 816/1613] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:01:19.797334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.798366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.798904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.799406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.800586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.802774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.802922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.814919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9bf23-2a1e-40f7-a7d5-ee53239df047 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.821961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 798/1614] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:19.822199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.822199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.822199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.822199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.822862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.823172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.824091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.838968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f63350-0597-4ee5-ade3-b16487ce40a1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:19.846801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e627093-9c51-41ba-b527-6644a2e19ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:19.847466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e627093-9c51-41ba-b527-6644a2e19ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.847747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e627093-9c51-41ba-b527-6644a2e19ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.848001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e627093-9c51-41ba-b527-6644a2e19ce9 admin admin] PATH_INFO: `/v3/projects/8863b997cf534fc980dff9ca860196b9/users/50ebf7bf3a7d48fbb47a351b1fa435d3/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.859446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 817/1615] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:19.864376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:19.871065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e627093-9c51-41ba-b527-6644a2e19ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8863b997cf534fc980dff9ca860196b9, user_id=50ebf7bf3a7d48fbb47a351b1fa435d3, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:19.874080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e627093-9c51-41ba-b527-6644a2e19ce9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:19.891037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 799/1616] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:19 2022] PUT /identity/v3/projects/8863b997cf534fc980dff9ca860196b9/users/50ebf7bf3a7d48fbb47a351b1fa435d3/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:19.900604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:19.901810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:19.902090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:19.902350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:19.948197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] MFA Rules not processed for user `50ebf7bf3a7d48fbb47a351b1fa435d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:19.949535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:19.964337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:19.970460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d83d5e-b3e6-4b8a-8560-439554fc5fbf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.060075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 800/1617] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:20.074715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.076477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:20.080424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.081265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.081797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.082301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.083353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.085693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.115804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 818/1618] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:19 2022] POST /identity/v3/users => generated 283 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:20.120352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.132501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3ad9-dde1-4fd0-b464-62316b01a499 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.138981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.139725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.140106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.140446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.141174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.143121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.162617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 819/1619] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:20.164492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4c8e6-b644-42e7-9574-a685c2976026 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.166288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.170961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c241629-feea-425a-a2ee-d290f96194d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.172018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241629-feea-425a-a2ee-d290f96194d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.172514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241629-feea-425a-a2ee-d290f96194d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.172993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241629-feea-425a-a2ee-d290f96194d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.180640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64055-4e07-44f4-8008-583a0b02290f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.187853 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.188656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.188933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.189198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.189924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.190381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c241629-feea-425a-a2ee-d290f96194d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.191611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.194099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c241629-feea-425a-a2ee-d290f96194d7 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.213494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 820/1620] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:20.221233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.222783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 801/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:20.244503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155544d5-8bed-4e97-a4e2-6dea51603389 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.253005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.254136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.254784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.255253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] PATH_INFO: `/v3/projects/0a5395d582ed4c1c9730306ac9e97d7c/users/5cab2e39217b458c8e722ac4cc0664e1/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.274804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5395d582ed4c1c9730306ac9e97d7c, user_id=5cab2e39217b458c8e722ac4cc0664e1, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.278012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.300324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 821/1622] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:20 2022] PUT /identity/v3/projects/0a5395d582ed4c1c9730306ac9e97d7c/users/5cab2e39217b458c8e722ac4cc0664e1/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:20.318396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd206-ec04-4f16-abc2-747d9091c086 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.318825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd206-ec04-4f16-abc2-747d9091c086 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.319314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd206-ec04-4f16-abc2-747d9091c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.358537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fb2bd206-ec04-4f16-abc2-747d9091c086 None None] MFA Rules not processed for user `5cab2e39217b458c8e722ac4cc0664e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:20.360320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fb2bd206-ec04-4f16-abc2-747d9091c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:20.605197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 802/1623] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:20.609582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.719778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895ebf4-1173-4c88-a0d4-1dcf72321fdd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.724696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.725405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.725677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.725951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.726756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.728801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.757692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:20.776719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 822/1624] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:20 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:20.777709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bd206-ec04-4f16-abc2-747d9091c086 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.789924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bd206-ec04-4f16-abc2-747d9091c086 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.852267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:20.870221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.870832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.871109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.871479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.872011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.874143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.905590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 803/1625] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:20 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:20.910474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.923379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6290f-f630-480f-b997-a1a641b45f5f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.934003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.935049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.935198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.935865 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:20.936417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:20.938138 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:20.956239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 823/1626] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:20.971296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:20.985959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190a63d-13d8-4fd1-bc41-77fec5d0efa0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:20.990980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:20.991655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:20.991924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:20.992193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] PATH_INFO: `/v3/projects/e2f0d4a4b465401680af82f1412cab32/users/7470983d457f40cb933e0829ce59605d/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:21.010166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f0d4a4b465401680af82f1412cab32, user_id=7470983d457f40cb933e0829ce59605d, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:21.013173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:21.034538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 804/1627] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:20 2022] PUT /identity/v3/projects/e2f0d4a4b465401680af82f1412cab32/users/7470983d457f40cb933e0829ce59605d/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:21.039484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:21.050377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adccfd-829c-418d-bad6-25b9e80d9d70 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:21.124012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78b66c-c782-43c1-9042-66ccb331a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:21.124810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b66c-c782-43c1-9042-66ccb331a615 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:21.125161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b66c-c782-43c1-9042-66ccb331a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:21.125542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78b66c-c782-43c1-9042-66ccb331a615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:21.126393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78b66c-c782-43c1-9042-66ccb331a615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:21.128264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78b66c-c782-43c1-9042-66ccb331a615 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:21.139603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 824/1628] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:21.143777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:21.154363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba7f78-9028-4bbe-a005-026d9e441ece admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:21.158930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:21.159612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:21.159889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:21.160151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] PATH_INFO: `/v3/projects/e2f0d4a4b465401680af82f1412cab32/users/7470983d457f40cb933e0829ce59605d/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:21.162066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f0d4a4b465401680af82f1412cab32, user_id=7470983d457f40cb933e0829ce59605d, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:21.165189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:21.176763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 805/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:21 2022] PUT /identity/v3/projects/e2f0d4a4b465401680af82f1412cab32/users/7470983d457f40cb933e0829ce59605d/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:21.188688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:21.188975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:21.189242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:21.222477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] MFA Rules not processed for user `7470983d457f40cb933e0829ce59605d`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:21.223773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:21.307858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 825/1630] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:21.322344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:21.384119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77debe-2b64-4f24-b0aa-edba7bdf7461 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:21.387939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d536a-eed6-4cfb-ba8f-e33a13880a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:21.388563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d536a-eed6-4cfb-ba8f-e33a13880a5a service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:21.388836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d536a-eed6-4cfb-ba8f-e33a13880a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:21.389083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d536a-eed6-4cfb-ba8f-e33a13880a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:21.399178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d536a-eed6-4cfb-ba8f-e33a13880a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:21.400657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d536a-eed6-4cfb-ba8f-e33a13880a5a service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:21.411956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 806/1631] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:21.504216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:21.506531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:21.519259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376cb9-916f-4b55-b94f-b6235681343a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:21.522938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75739f-ef94-4f59-9d40-545e30f79b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:21.523484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75739f-ef94-4f59-9d40-545e30f79b53 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:21.523786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75739f-ef94-4f59-9d40-545e30f79b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:21.524016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75739f-ef94-4f59-9d40-545e30f79b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:21.588786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75739f-ef94-4f59-9d40-545e30f79b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:21.590270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75739f-ef94-4f59-9d40-545e30f79b53 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:21.601107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 826/1632] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:26.664261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79349c-1d2f-4090-9b98-250b6c2f028f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:26.664815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79349c-1d2f-4090-9b98-250b6c2f028f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:26.665002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79349c-1d2f-4090-9b98-250b6c2f028f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:26.666514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 807/1633] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:01:26.697919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d9ff-3619-4238-8377-1f3c2edcfbdf None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:26.698684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d9ff-3619-4238-8377-1f3c2edcfbdf None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:26.699125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d9ff-3619-4238-8377-1f3c2edcfbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:26.716581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:26.732034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3a49d9ff-3619-4238-8377-1f3c2edcfbdf None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:26.733666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3a49d9ff-3619-4238-8377-1f3c2edcfbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:26.753147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79349c-1d2f-4090-9b98-250b6c2f028f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:26.758194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-aa79349c-1d2f-4090-9b98-250b6c2f028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:26.878023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79349c-1d2f-4090-9b98-250b6c2f028f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:26.882434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 827/1634] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:01:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:26.890790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:26.891892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:26.892702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:26.893274 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] PATH_INFO: `/v3/users/d35bcd2d840a4fd4be9c0ac0fff6d6e9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:26.895437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35bcd2d840a4fd4be9c0ac0fff6d6e9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:26.897630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:26.901649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd04c8-c241-4e2a-8ff9-ccf9acf8d43f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:26.902304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd04c8-c241-4e2a-8ff9-ccf9acf8d43f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:26.902588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd04c8-c241-4e2a-8ff9-ccf9acf8d43f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:26.906889 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 828/1635] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 11 12:01:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 11 12:01:26.922525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff206-853c-406b-a0f8-8a5d21609974 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:26.922841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff206-853c-406b-a0f8-8a5d21609974 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:26.923118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff206-853c-406b-a0f8-8a5d21609974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:26.964433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-db8ff206-853c-406b-a0f8-8a5d21609974 None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:26.968379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-db8ff206-853c-406b-a0f8-8a5d21609974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:26.999876 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:27.002535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 829/1636] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 11 12:01:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:27.009205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35bcd2d840a4fd4be9c0ac0fff6d6e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.011144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35bcd2d840a4fd4be9c0ac0fff6d6e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.012896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ff206-853c-406b-a0f8-8a5d21609974 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:27.032608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35bcd2d840a4fd4be9c0ac0fff6d6e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.034706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ff206-853c-406b-a0f8-8a5d21609974 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:27.045777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:27.046809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.047223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.047773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.051482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35bcd2d840a4fd4be9c0ac0fff6d6e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.053651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35bcd2d840a4fd4be9c0ac0fff6d6e9'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.064958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:27.075162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:27.080643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 808/1637] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:26 2022] DELETE /identity/v3/users/d35bcd2d840a4fd4be9c0ac0fff6d6e9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:27.095426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 830/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:27.250436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:27.252115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:27.328004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fec74-3d92-42a5-b8f3-115235883151 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:27.333387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:27.334050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.334295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.334591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] PATH_INFO: `/v3/users/5cab2e39217b458c8e722ac4cc0664e1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.335910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cab2e39217b458c8e722ac4cc0664e1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:27.337970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:27.401409 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cab2e39217b458c8e722ac4cc0664e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.402330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cab2e39217b458c8e722ac4cc0664e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.438017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:27.440552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cab2e39217b458c8e722ac4cc0664e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.452352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cab2e39217b458c8e722ac4cc0664e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.453147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-173c72b9-292d-4cd9-8d2c-f4c46629f46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cab2e39217b458c8e722ac4cc0664e1'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.469996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b46f4-9d7d-4daf-a5a9-d9f0f5acf36a service placement] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:27.476385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:27.477270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.477485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.477754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] PATH_INFO: `/v3/projects/30cdbda9e6e44631ae86ef4733bc2418` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.479235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cdbda9e6e44631ae86ef4733bc2418)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:27.482617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:27.493385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 809/1639] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:27 2022] DELETE /identity/v3/users/5cab2e39217b458c8e722ac4cc0664e1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:27.504215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.504215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.504215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.535477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:27.539650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:27.560530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cdbda9e6e44631ae86ef4733bc2418', 'request_id': 'req-330efb7a-1137-46d4-b248-a64c2c4a0b6d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.570390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cdbda9e6e44631ae86ef4733bc2418', 'request_id': 'req-330efb7a-1137-46d4-b248-a64c2c4a0b6d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.582771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cdbda9e6e44631ae86ef4733bc2418', 'request_id': 'req-330efb7a-1137-46d4-b248-a64c2c4a0b6d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.594814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:27.606428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] The token cache is being invalidate because project 30cdbda9e6e44631ae86ef4733bc2418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:27.610622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.610622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-330efb7a-1137-46d4-b248-a64c2c4a0b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:27.610622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 831/1640] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:27 2022] DELETE /identity/v3/projects/30cdbda9e6e44631ae86ef4733bc2418 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:27.635953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 810/1641] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:27.645639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8590-fd4a-4873-aca6-72a739677bb2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.646148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8590-fd4a-4873-aca6-72a739677bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.646666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8590-fd4a-4873-aca6-72a739677bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.649141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:27.650602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:27.708429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f1dd8590-fd4a-4873-aca6-72a739677bb2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:27.709815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f1dd8590-fd4a-4873-aca6-72a739677bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:27.734789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 832/1642] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:27.737074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df39bc-acf2-43c7-a0c4-7b147a1c4488 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.737565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df39bc-acf2-43c7-a0c4-7b147a1c4488 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.737565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df39bc-acf2-43c7-a0c4-7b147a1c4488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.747063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f4f8-2793-4632-b2a8-c9f130524072 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:27.753022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:27.753999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.754510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.754991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.771939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:27.776079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:27.784253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b7df39bc-acf2-43c7-a0c4-7b147a1c4488 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:27.786197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b7df39bc-acf2-43c7-a0c4-7b147a1c4488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:27.798748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 811/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:27.806715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 833/1644] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:27.813122 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:27.833428 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4283f-b580-4f48-9f83-9a32832687e4 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:27.842596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:27.843602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.844056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.844762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.845594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:27.846115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:27.849211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:27.871175 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 812/1645] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:27.876856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df39bc-acf2-43c7-a0c4-7b147a1c4488 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:27.896323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df39bc-acf2-43c7-a0c4-7b147a1c4488 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:27.907217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:27.908459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:27.909303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:27.909985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:27.911499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:27.915616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:27.980808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 834/1646] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:27 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:27.986582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.013284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38162b-d367-4471-b474-0369a6c3a761 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.120145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.120929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.121376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.121653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.122506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.125314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.171895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 813/1647] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:27 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:28.178172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.214022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59450661-7d13-4961-b12a-bae691f23184 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.226009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.227165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.231307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.231307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.232008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.233720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.254611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 835/1648] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:28.256852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.269889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d38eb4-5e56-4ffa-822c-928cf8e7b91a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.285629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.287016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.287585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.288126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.291491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.295009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.322976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 814/1649] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:28.329249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.343322 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e046-8f92-4be1-8fc0-85c481381c6c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.348705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ca09-76f6-47fd-b167-3730c960ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.349417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ca09-76f6-47fd-b167-3730c960ce9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.349687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ca09-76f6-47fd-b167-3730c960ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.349973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ca09-76f6-47fd-b167-3730c960ce9a admin admin] PATH_INFO: `/v3/projects/d0952f68de7a4e1dac6f0b5b14222802/users/e96b5c44c9dd42539ebf2c18c4aa8e79/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.361426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.363523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:28.372110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660ca09-76f6-47fd-b167-3730c960ce9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0952f68de7a4e1dac6f0b5b14222802, user_id=e96b5c44c9dd42539ebf2c18c4aa8e79, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.377785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfed965-40b3-42cf-a34b-7515bbc2d7d9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.380832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660ca09-76f6-47fd-b167-3730c960ce9a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.383158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.383891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.384234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.384558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] PATH_INFO: `/v3/projects/0a5395d582ed4c1c9730306ac9e97d7c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.385859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5395d582ed4c1c9730306ac9e97d7c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.386031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:28.388857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.406727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 836/1650] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:28 2022] PUT /identity/v3/projects/d0952f68de7a4e1dac6f0b5b14222802/users/e96b5c44c9dd42539ebf2c18c4aa8e79/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:28.417814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.418227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.418617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.450679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:28.455058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5395d582ed4c1c9730306ac9e97d7c', 'request_id': 'req-07193cf3-b46f-460a-a700-f8ed26577ce6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.457809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] MFA Rules not processed for user `e96b5c44c9dd42539ebf2c18c4aa8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:28.459473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:28.462920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5395d582ed4c1c9730306ac9e97d7c', 'request_id': 'req-07193cf3-b46f-460a-a700-f8ed26577ce6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.475831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5395d582ed4c1c9730306ac9e97d7c', 'request_id': 'req-07193cf3-b46f-460a-a700-f8ed26577ce6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.493807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] The token cache is being invalidate because project 0a5395d582ed4c1c9730306ac9e97d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:28.494123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.494880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.496466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 815/1651] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:28 2022] DELETE /identity/v3/projects/0a5395d582ed4c1c9730306ac9e97d7c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:28.500943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.503021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:28.574608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 837/1652] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:28.579593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.580862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193cf3-b46f-460a-a700-f8ed26577ce6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.582457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:28.587372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.589051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.589330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.590233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] PATH_INFO: `/v3/users/7470983d457f40cb933e0829ce59605d` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.591710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7470983d457f40cb933e0829ce59605d)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.593990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.610747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13a065-4d89-415c-b8d6-1cd6a7094e17 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.621005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.622264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.622829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.623627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.625090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.629102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.668904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7470983d457f40cb933e0829ce59605d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.670605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7470983d457f40cb933e0829ce59605d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.683194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 838/1653] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:28 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:28.690208 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.705778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7470983d457f40cb933e0829ce59605d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.723999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7470983d457f40cb933e0829ce59605d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.724907 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7470983d457f40cb933e0829ce59605d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:28.744089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 816/1654] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:28 2022] DELETE /identity/v3/users/7470983d457f40cb933e0829ce59605d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:28.802458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a354-a45e-49e7-ad81-4ab7a6359df6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.911746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.912395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.912673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.912944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.913917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.916150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.936759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:28.944969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 839/1655] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:28 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:28.949667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:28.951567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:28.965456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b9489-b685-4e38-8b89-95af9111de37 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:28.972333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:28.972969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:28.973244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:28.973513 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:28.974178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:28.977164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:28.993950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 817/1656] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:29.000991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.028471 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb112c6-3baa-4acf-8f5d-a9c433f06c09 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.036819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:29.038219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.038891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.039373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] PATH_INFO: `/v3/projects/b1dd40d7bb9f4992bc877fc94bfd8692/users/12c53e6345a4432b92cf306293fc930b/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.060605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1dd40d7bb9f4992bc877fc94bfd8692, user_id=12c53e6345a4432b92cf306293fc930b, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:29.065042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:29.086538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 840/1657] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:28 2022] PUT /identity/v3/projects/b1dd40d7bb9f4992bc877fc94bfd8692/users/12c53e6345a4432b92cf306293fc930b/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:29.092149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.110307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c29a0-a5c2-4d7a-9432-8778c970baff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.151731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.154692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:29.176588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:29.213263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:29.214011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.214395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.214840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.216172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:29.218760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:29.237567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 818/1658] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:29.239159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.256440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf4993-bc44-434f-8ef0-cebb2fccb7ae admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.266889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b030ea-e39d-4395-b22d-8b1807624a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:29.268360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b030ea-e39d-4395-b22d-8b1807624a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.268836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b030ea-e39d-4395-b22d-8b1807624a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.269338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b030ea-e39d-4395-b22d-8b1807624a6a admin admin] PATH_INFO: `/v3/projects/b1dd40d7bb9f4992bc877fc94bfd8692/users/12c53e6345a4432b92cf306293fc930b/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.273486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b030ea-e39d-4395-b22d-8b1807624a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1dd40d7bb9f4992bc877fc94bfd8692, user_id=12c53e6345a4432b92cf306293fc930b, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:29.279807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b030ea-e39d-4395-b22d-8b1807624a6a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:29.292157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d47812-bbf3-4e81-b203-fbc76419a5b0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.306675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 819/1659] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:29 2022] PUT /identity/v3/projects/b1dd40d7bb9f4992bc877fc94bfd8692/users/12c53e6345a4432b92cf306293fc930b/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:29.325429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466c998-ce6e-45e1-a182-72ee383ac249 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.325957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466c998-ce6e-45e1-a182-72ee383ac249 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.326600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466c998-ce6e-45e1-a182-72ee383ac249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.383989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d466c998-ce6e-45e1-a182-72ee383ac249 None None] MFA Rules not processed for user `12c53e6345a4432b92cf306293fc930b`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:29.385955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d466c998-ce6e-45e1-a182-72ee383ac249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:29.435924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:29.437171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.437716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.438275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] PATH_INFO: `/v3/projects/e2f0d4a4b465401680af82f1412cab32` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.441009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f0d4a4b465401680af82f1412cab32)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:29.446054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:29.527801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f0d4a4b465401680af82f1412cab32', 'request_id': 'req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:29.541058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f0d4a4b465401680af82f1412cab32', 'request_id': 'req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:29.560451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f0d4a4b465401680af82f1412cab32', 'request_id': 'req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:29.574153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 820/1660] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:29.577294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] The token cache is being invalidate because project e2f0d4a4b465401680af82f1412cab32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:29.577797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:29.579048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:29.586435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 841/1661] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:29 2022] DELETE /identity/v3/projects/e2f0d4a4b465401680af82f1412cab32 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:29.588813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1476-cb04-4454-b44c-f04e7ce8b1e7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.589099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1476-cb04-4454-b44c-f04e7ce8b1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.589413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1476-cb04-4454-b44c-f04e7ce8b1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.623727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e35e1476-cb04-4454-b44c-f04e7ce8b1e7 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:29.624999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e35e1476-cb04-4454-b44c-f04e7ce8b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:29.625103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.628371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:29.664674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:29.727909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 821/1662] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:29.736465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bac41-e643-4277-9230-6defc6a0cc01 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.736782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bac41-e643-4277-9230-6defc6a0cc01 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.737493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bac41-e643-4277-9230-6defc6a0cc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.762981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bf3bac41-e643-4277-9230-6defc6a0cc01 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:29.764313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bf3bac41-e643-4277-9230-6defc6a0cc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:29.767991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b91c22-ac60-4e2e-bd4f-b47e7e58b002 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.773674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 822/1663] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:29.776972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:29.778469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bac41-e643-4277-9230-6defc6a0cc01 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.779151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.779852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.781049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.786929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:29.805926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bac41-e643-4277-9230-6defc6a0cc01 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.816848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:29.817823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.818342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.818850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.820380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:29.820890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:29.824878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:29.847941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 823/1664] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:29.853254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.867145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f40dd7-0d54-4ddf-9b4d-087a622faf89 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.885666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:29.888405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:29.888405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:29.888405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:29.888405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:29.892117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:29.895408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:29.897374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:29.909617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 842/1665] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:29.938953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 824/1666] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:29 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:29.941061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.970783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf172d0-e473-42db-9d9a-52c781234c76 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:29.976768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:29.991536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:30.094466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:30.095732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.096375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.097123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.098900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:30.103332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:30.132235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09598786-3a75-444a-8050-bb1d207d0ed6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:30.135240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 843/1667] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:29 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:30.139590 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:30.147464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b654-f006-4bd1-9947-3a0795ff4b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:30.149467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b654-f006-4bd1-9947-3a0795ff4b42 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.150085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b654-f006-4bd1-9947-3a0795ff4b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.150810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b654-f006-4bd1-9947-3a0795ff4b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.152385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1184dd-da47-4598-abe1-9f35d05be15b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:30.154595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5110b654-f006-4bd1-9947-3a0795ff4b42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:30.158805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:30.160734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.161279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.161721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.162896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:30.165218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:30.180386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 844/1668] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:30.184555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:30.196604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcbe33-61e2-4545-a0f2-3c09a7d69ac4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:30.202299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:30.203011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.203268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.203531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.204202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:30.205968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:30.218739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 845/1669] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:30.225029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:30.241716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b408-52ba-40d5-ab79-74cb2c246b14 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:30.248064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:30.248749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.249041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.249287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] PATH_INFO: `/v3/projects/09d60fd1f22e4cf5961d85f43f87d7ce/users/b9db2dcc6e7b413d93595a74f8f59b4f/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.260166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b654-f006-4bd1-9947-3a0795ff4b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:30.262683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b654-f006-4bd1-9947-3a0795ff4b42 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:30.273954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d60fd1f22e4cf5961d85f43f87d7ce, user_id=b9db2dcc6e7b413d93595a74f8f59b4f, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:30.276647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:30.278594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 825/1670] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:30.293684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 846/1671] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:30 2022] PUT /identity/v3/projects/09d60fd1f22e4cf5961d85f43f87d7ce/users/b9db2dcc6e7b413d93595a74f8f59b4f/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:30.300339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.300626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.301054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.330192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:30.332699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:30.429372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 826/1672] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:30.443176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:30.445660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:30.457115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:30.529846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90d26c-b43c-45a5-af76-e5bcbd905b27 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:30.533945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608e3f6-77b2-4d70-a469-1b4f24433b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:30.534617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e3f6-77b2-4d70-a469-1b4f24433b3b service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.534905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e3f6-77b2-4d70-a469-1b4f24433b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.535218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608e3f6-77b2-4d70-a469-1b4f24433b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.546818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608e3f6-77b2-4d70-a469-1b4f24433b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:30.548268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608e3f6-77b2-4d70-a469-1b4f24433b3b service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:30.563087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 847/1673] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:30.672628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:30.674422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:30.710910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa6025-ed02-41b8-9bc7-88c830710fa8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:30.717785 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:30.719112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.719625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.719893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] PATH_INFO: `/v3/users/101130a7b91d406c9b0d088f344e05cf` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.721476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101130a7b91d406c9b0d088f344e05cf)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:30.724041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:30.794825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101130a7b91d406c9b0d088f344e05cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:30.795541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101130a7b91d406c9b0d088f344e05cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:30.805689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:30.815296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101130a7b91d406c9b0d088f344e05cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:30.835317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101130a7b91d406c9b0d088f344e05cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:30.836704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101130a7b91d406c9b0d088f344e05cf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:30.863685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 827/1674] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:30 2022] DELETE /identity/v3/users/101130a7b91d406c9b0d088f344e05cf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:30.869924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ccc03-3f4a-4371-acd1-b9696afa0a3d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:30.870896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ccc03-3f4a-4371-acd1-b9696afa0a3d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:30.871568 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ccc03-3f4a-4371-acd1-b9696afa0a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:30.901334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-425ccc03-3f4a-4371-acd1-b9696afa0a3d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:30.902653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-425ccc03-3f4a-4371-acd1-b9696afa0a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:31.014392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 848/1675] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:31.028995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:31.030725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:31.171050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f058d6-0938-4618-9ecf-789e67d8aad4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:31.180855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:31.182086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:31.182681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:31.183166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:31.214075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:31.216221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:31.228929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 828/1676] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:31.642792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:31.643262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:31.643538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:31.682672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] MFA Rules not processed for user `b9db2dcc6e7b413d93595a74f8f59b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:31.684152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:31.847443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:31.849242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 849/1677] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:31.851465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:31.859633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:31.861317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:31.891237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985c8f3-1787-4d2d-9f06-3835d71dc978 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:31.896585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fab68-73bf-408a-abb5-22abf99dcbbe service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:31.898003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:31.898797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:31.899190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:31.900427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:31.901330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:31.904799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:31.907599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:31.908225 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:31.908831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:31.909410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] PATH_INFO: `/v3/projects/a75bfc8426184300a1ac1314a9540e21` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:31.911750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75bfc8426184300a1ac1314a9540e21)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:31.917179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:31.951049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 850/1678] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:31 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:31.955367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:32.014639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:32.042864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75bfc8426184300a1ac1314a9540e21', 'request_id': 'req-d471b585-193c-4cfd-b554-1fc256e6040b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.053606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75bfc8426184300a1ac1314a9540e21', 'request_id': 'req-d471b585-193c-4cfd-b554-1fc256e6040b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.068286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75bfc8426184300a1ac1314a9540e21', 'request_id': 'req-d471b585-193c-4cfd-b554-1fc256e6040b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.090065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] The token cache is being invalidate because project a75bfc8426184300a1ac1314a9540e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:32.090361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.091178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.091734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4286b1-ee94-4db9-bd76-a200fd7dd7e8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:32.093319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 829/1679] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:31 2022] DELETE /identity/v3/projects/a75bfc8426184300a1ac1314a9540e21 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:32.097870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:32.100174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:32.194102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:32.195424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:32.196173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:32.196537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:32.197850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:32.201525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:32.210354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471b585-193c-4cfd-b554-1fc256e6040b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:32.217793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:32.219108 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:32.219425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:32.219696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] PATH_INFO: `/v3/users/e3ecc55f0c23463d9df10ea9443b4789` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:32.221009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ecc55f0c23463d9df10ea9443b4789)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:32.223281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:32.226322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:32.242749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 851/1680] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:31 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:32.248567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:32.251576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:32.273168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42468a32-4c4d-4f2a-a246-1308f679865c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:32.281934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:32.283359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:32.283359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:32.283783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:32.284886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:32.288343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:32.307568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ecc55f0c23463d9df10ea9443b4789'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.308596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ecc55f0c23463d9df10ea9443b4789'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.310624 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 852/1681] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:32.314335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:32.327254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e142cb5-8db1-4c27-bb1d-5cf35a3fb85d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:32.332760 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:32.333755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:32.333956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:32.334244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] PATH_INFO: `/v3/projects/6844715c948b433097efdf19ee550681/users/d0414f75c5f345729a7ffb782e894bd3/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:32.338393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ecc55f0c23463d9df10ea9443b4789'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.356749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ecc55f0c23463d9df10ea9443b4789'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.358450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ecc55f0c23463d9df10ea9443b4789'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:32.375302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6844715c948b433097efdf19ee550681, user_id=d0414f75c5f345729a7ffb782e894bd3, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:32.378950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:32.385810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 830/1682] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:32 2022] DELETE /identity/v3/users/e3ecc55f0c23463d9df10ea9443b4789 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:32.426844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 853/1683] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:32 2022] PUT /identity/v3/projects/6844715c948b433097efdf19ee550681/users/d0414f75c5f345729a7ffb782e894bd3/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:32.431101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:32.436148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:32.546993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f2175-a47d-4c33-a537-2411541362ed admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:32.662100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:32.663971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:32.664628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:32.665220 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:32.666585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:32.671031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:32.689487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 831/1684] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:32.693994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:32.710331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0e996-943c-4375-9120-2b999c495cbb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:32.718609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416bef6-8558-4ce3-b1b5-130170eccf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:32.722205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416bef6-8558-4ce3-b1b5-130170eccf63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:32.722947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416bef6-8558-4ce3-b1b5-130170eccf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:32.723238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416bef6-8558-4ce3-b1b5-130170eccf63 admin admin] PATH_INFO: `/v3/projects/6844715c948b433097efdf19ee550681/users/d0414f75c5f345729a7ffb782e894bd3/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:32.725900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416bef6-8558-4ce3-b1b5-130170eccf63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6844715c948b433097efdf19ee550681, user_id=d0414f75c5f345729a7ffb782e894bd3, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:32.729031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416bef6-8558-4ce3-b1b5-130170eccf63 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:32.744811 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 854/1685] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:32 2022] PUT /identity/v3/projects/6844715c948b433097efdf19ee550681/users/d0414f75c5f345729a7ffb782e894bd3/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:32.966946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:32.970110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:33.015029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a61939-d004-4091-a319-327c7f2a1c10 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:33.047997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:33.120043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:33.121111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:33.121581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:33.122151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] PATH_INFO: `/v3/projects/746e8ba09b314f50887689a11157653d` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:33.124071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=746e8ba09b314f50887689a11157653d)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:33.126147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:33.200361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746e8ba09b314f50887689a11157653d', 'request_id': 'req-24174150-27ee-48ed-a414-b9da01aec9ef'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:33.208649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746e8ba09b314f50887689a11157653d', 'request_id': 'req-24174150-27ee-48ed-a414-b9da01aec9ef'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:33.220402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746e8ba09b314f50887689a11157653d', 'request_id': 'req-24174150-27ee-48ed-a414-b9da01aec9ef'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:33.236332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] The token cache is being invalidate because project 746e8ba09b314f50887689a11157653d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:33.236623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:33.237331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-24174150-27ee-48ed-a414-b9da01aec9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:33.239627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 832/1686] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:32 2022] DELETE /identity/v3/projects/746e8ba09b314f50887689a11157653d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:33.246370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c45e-111d-4b40-81c9-abe4a7cd77ee None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:33.247030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c45e-111d-4b40-81c9-abe4a7cd77ee None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:33.247475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108c45e-111d-4b40-81c9-abe4a7cd77ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:33.280284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5108c45e-111d-4b40-81c9-abe4a7cd77ee None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:33.281697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5108c45e-111d-4b40-81c9-abe4a7cd77ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:33.361902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 855/1687] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:33.371573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8535a53-344e-4a6c-8cd4-0272b4b10a5a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:33.371952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8535a53-344e-4a6c-8cd4-0272b4b10a5a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:33.372275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8535a53-344e-4a6c-8cd4-0272b4b10a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:33.393596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d8535a53-344e-4a6c-8cd4-0272b4b10a5a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:33.394831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d8535a53-344e-4a6c-8cd4-0272b4b10a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:33.404168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 833/1688] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:33.411098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108c45e-111d-4b40-81c9-abe4a7cd77ee None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:33.423826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:33.432402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108c45e-111d-4b40-81c9-abe4a7cd77ee None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:33.442795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:33.443878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:33.444215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:33.444641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:33.446003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:33.446003 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:33.449031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:33.472632 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 856/1689] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:33.479714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8535a53-344e-4a6c-8cd4-0272b4b10a5a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:33.494824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8535a53-344e-4a6c-8cd4-0272b4b10a5a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:33.506511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:33.508868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:33.509636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:33.510249 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:33.511677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:33.517255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:33.590628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 834/1690] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:33 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:33.596151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:33.621167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f185de-7013-4ef8-843c-81b70fab0cfd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:33.789689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20543aea-549e-4fe7-824e-75c51f86e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:33.791566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20543aea-549e-4fe7-824e-75c51f86e2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:33.792083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20543aea-549e-4fe7-824e-75c51f86e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:33.792520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20543aea-549e-4fe7-824e-75c51f86e2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:33.794246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20543aea-549e-4fe7-824e-75c51f86e2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:33.804209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20543aea-549e-4fe7-824e-75c51f86e2c7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:33.884206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 857/1691] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:33 2022] POST /identity/v3/users => generated 296 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:33.891992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:33.937135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a0587-af93-43f6-bb70-635f1629466d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:33.958770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:33.959704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:33.960174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:33.960612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:33.961843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:33.969136 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:34.019520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659abbd-2611-4af1-bc31-2cdc7fee4b65 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.019836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659abbd-2611-4af1-bc31-2cdc7fee4b65 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.020111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659abbd-2611-4af1-bc31-2cdc7fee4b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.022353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 835/1692] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:34.029700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:34.076403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d659abbd-2611-4af1-bc31-2cdc7fee4b65 None None] MFA Rules not processed for user `d0414f75c5f345729a7ffb782e894bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:34.079272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc017d-5bdc-44cd-8c11-524b4cb70a37 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:34.081407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d659abbd-2611-4af1-bc31-2cdc7fee4b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:34.129721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:34.130954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.131442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.131932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.136280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:34.146901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:34.164891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 836/1693] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:34.169600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:34.202699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b4bee-54f1-40ee-ba9a-e0e4d8de71fd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:34.228956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898eb8e2-84ed-4a73-8155-8c91aa04566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:34.231786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898eb8e2-84ed-4a73-8155-8c91aa04566d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.234729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898eb8e2-84ed-4a73-8155-8c91aa04566d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.235442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898eb8e2-84ed-4a73-8155-8c91aa04566d admin admin] PATH_INFO: `/v3/projects/08a27336afad4eb892797af74b1ebb38/users/2724de2ebfbd44399f598b06dec39a4a/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.270711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 858/1694] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:34.271209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898eb8e2-84ed-4a73-8155-8c91aa04566d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a27336afad4eb892797af74b1ebb38, user_id=2724de2ebfbd44399f598b06dec39a4a, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:34.273767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898eb8e2-84ed-4a73-8155-8c91aa04566d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:34.281247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.281531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.282649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.297015 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 837/1695] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:34 2022] PUT /identity/v3/projects/08a27336afad4eb892797af74b1ebb38/users/2724de2ebfbd44399f598b06dec39a4a/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:34.311886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fa63-1988-4ae0-a2b1-9af844ec94d8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.312396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fa63-1988-4ae0-a2b1-9af844ec94d8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.312698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fa63-1988-4ae0-a2b1-9af844ec94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.318925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] MFA Rules not processed for user `b9db2dcc6e7b413d93595a74f8f59b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:34.320478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:34.383226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2402fa63-1988-4ae0-a2b1-9af844ec94d8 None None] MFA Rules not processed for user `2724de2ebfbd44399f598b06dec39a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:34.384909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2402fa63-1988-4ae0-a2b1-9af844ec94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:34.428628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:34.437745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 859/1696] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:34.453812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:34.461412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:34.495496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:34.561551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 838/1697] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:34.567840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402fa63-1988-4ae0-a2b1-9af844ec94d8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:34.618013 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dba8d-866a-417e-a257-be95f48a6f21 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:34.632378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:34.634335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.635384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.635911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.643988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:34.680935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:34.683897 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:34.700906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 860/1698] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:34.701987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:34.703803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:34.773716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402fa63-1988-4ae0-a2b1-9af844ec94d8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:34.779134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:34.780211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.780646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.781074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.782074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:34.784386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:34.817973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d5e6b-413e-4fe6-b05e-e2fc5c239d5e service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:34.823639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:34.824427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.825027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.825463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] PATH_INFO: `/v3/users/e96b5c44c9dd42539ebf2c18c4aa8e79` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.827071 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96b5c44c9dd42539ebf2c18c4aa8e79)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:34.829403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:34.845236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 839/1699] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:34 2022] POST /identity/v3/projects => generated 393 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:34.850217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:34.921395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96b5c44c9dd42539ebf2c18c4aa8e79'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:34.923776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96b5c44c9dd42539ebf2c18c4aa8e79'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:34.938211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96b5c44c9dd42539ebf2c18c4aa8e79'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:34.952001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96b5c44c9dd42539ebf2c18c4aa8e79'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:34.953399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c2f08-1292-4dea-930a-dc1f94cac420 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:34.959502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:34.960266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:34.960680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:34.961030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:34.961790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:34.964050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:34.979463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e7f46073-ac39-4866-8616-0a3da9d16cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96b5c44c9dd42539ebf2c18c4aa8e79'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:35.005653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 840/1700] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:34 2022] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:35.005822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 861/1701] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:34 2022] DELETE /identity/v3/users/e96b5c44c9dd42539ebf2c18c4aa8e79 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:35.006208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:35.014995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:35.015327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:35.015585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:35.018160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:35.052648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:35.054752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:35.055213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb54db-044a-4607-a851-0f41a30c49ee admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:35.070595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:35.138714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:35.174673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 862/1702] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:35.176233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:35.177067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:35.177759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:35.178913 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:35.179715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:35.181489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:35.189131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:35.192698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:35.195359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 841/1703] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:35.201460 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:35.222905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41734a-bff3-483f-bc70-924b5266026a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:35.237742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:35.239681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:35.240807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:35.241159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] PATH_INFO: `/v3/projects/b3b9ff8fc2b141f499f2ecc5fd57cc6b/users/03016ec200c14eab926e12a1dd86fbb2/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:35.311789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b9ff8fc2b141f499f2ecc5fd57cc6b, user_id=03016ec200c14eab926e12a1dd86fbb2, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:35.319289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:35.342081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ff40e-f1e0-4c7c-af12-0de2193a5715 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:35.345933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 842/1704] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:35 2022] PUT /identity/v3/projects/b3b9ff8fc2b141f499f2ecc5fd57cc6b/users/03016ec200c14eab926e12a1dd86fbb2/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:35.351248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:35.451693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:35.452206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:35.452485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:35.452754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:35.504845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e723-436f-44ba-95d2-7a2fe34c10df admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:35.511888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:35.512590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:35.512871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:35.514912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:35.516192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:35.519289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:35.536337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 843/1705] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:35.546728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:35.561854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde5ad3-3f33-419c-af15-6bfffaff96b6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:35.568823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712f19a-0a29-437e-bd0a-01fac2fc5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:35.569698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f19a-0a29-437e-bd0a-01fac2fc5448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:35.570055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f19a-0a29-437e-bd0a-01fac2fc5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:35.570434 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712f19a-0a29-437e-bd0a-01fac2fc5448 admin admin] PATH_INFO: `/v3/projects/b3b9ff8fc2b141f499f2ecc5fd57cc6b/users/03016ec200c14eab926e12a1dd86fbb2/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:35.573719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712f19a-0a29-437e-bd0a-01fac2fc5448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b9ff8fc2b141f499f2ecc5fd57cc6b, user_id=03016ec200c14eab926e12a1dd86fbb2, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:35.577762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712f19a-0a29-437e-bd0a-01fac2fc5448 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:35.581120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:35.582943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:35.602023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 844/1706] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:35 2022] PUT /identity/v3/projects/b3b9ff8fc2b141f499f2ecc5fd57cc6b/users/03016ec200c14eab926e12a1dd86fbb2/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:35.604637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:35.604842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:35.605134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:35.619877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 863/1707] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:35.657470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] MFA Rules not processed for user `03016ec200c14eab926e12a1dd86fbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:35.659972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:35.763644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 845/1708] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:35.775639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:35.778203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:35.853007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:35.933575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1f89-a411-43d1-b3a3-5b8170a4adfa service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:36.022514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:36.023618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:36.023735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:36.023997 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:36.040068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:36.042286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:36.057867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 864/1709] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:36.129731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:36.131373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:36.144995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b736e0-5743-4ee5-bbaf-fc3c86d49d63 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:36.149256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:36.150370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:36.151607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:36.151607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:36.154650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:36.165336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:36.173321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:36.208033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:36.285294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de172bb-f911-4f0f-bad5-77b6999c34bc service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:36.292456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:36.293413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:36.293830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:36.294334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] PATH_INFO: `/v3/projects/d0952f68de7a4e1dac6f0b5b14222802` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:36.294657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:36.295950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0952f68de7a4e1dac6f0b5b14222802)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:36.297550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:36.298320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:36.320393 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 846/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:36.381553 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0952f68de7a4e1dac6f0b5b14222802', 'request_id': 'req-bf3d51c3-35e6-4f66-b805-16cd680ec37f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.400664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0952f68de7a4e1dac6f0b5b14222802', 'request_id': 'req-bf3d51c3-35e6-4f66-b805-16cd680ec37f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.410028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0952f68de7a4e1dac6f0b5b14222802', 'request_id': 'req-bf3d51c3-35e6-4f66-b805-16cd680ec37f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.425841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] The token cache is being invalidate because project d0952f68de7a4e1dac6f0b5b14222802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:36.426297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.427368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.430094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 865/1711] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:36 2022] DELETE /identity/v3/projects/d0952f68de7a4e1dac6f0b5b14222802 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:36.436933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:36.455689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3fc52-f545-49f6-bb84-1107e2e5ed69 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:36.573608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:36.574586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:36.574885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:36.575149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] PATH_INFO: `/v3/users/12c53e6345a4432b92cf306293fc930b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:36.577470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c53e6345a4432b92cf306293fc930b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:36.580101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:36.681289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c53e6345a4432b92cf306293fc930b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.682884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c53e6345a4432b92cf306293fc930b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.709218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c53e6345a4432b92cf306293fc930b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.743478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c53e6345a4432b92cf306293fc930b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.744447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0ed73444-ed23-4ffc-b5c5-adf0cff78e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c53e6345a4432b92cf306293fc930b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:36.782763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 847/1712] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:36 2022] DELETE /identity/v3/users/12c53e6345a4432b92cf306293fc930b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:37.223785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:37.225392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:37.244724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d51c3-35e6-4f66-b805-16cd680ec37f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:37.265577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:37.353705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:37.354703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:37.354976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:37.355241 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] PATH_INFO: `/v3/projects/b1dd40d7bb9f4992bc877fc94bfd8692` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:37.356488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1dd40d7bb9f4992bc877fc94bfd8692)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:37.358406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:37.433539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1dd40d7bb9f4992bc877fc94bfd8692', 'request_id': 'req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:37.440831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1dd40d7bb9f4992bc877fc94bfd8692', 'request_id': 'req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:37.451086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1dd40d7bb9f4992bc877fc94bfd8692', 'request_id': 'req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:37.471229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] The token cache is being invalidate because project b1dd40d7bb9f4992bc877fc94bfd8692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:37.471633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:37.472434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-09b9c126-34b4-41d1-ae4c-8e9dbb93b9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:37.474327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 866/1713] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:37 2022] DELETE /identity/v3/projects/b1dd40d7bb9f4992bc877fc94bfd8692 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:37.479092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f084691-f682-4800-b273-dbda88e85f8a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:37.479605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f084691-f682-4800-b273-dbda88e85f8a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:37.479707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f084691-f682-4800-b273-dbda88e85f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:37.503717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1f084691-f682-4800-b273-dbda88e85f8a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:37.505121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1f084691-f682-4800-b273-dbda88e85f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:37.550852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:37.601691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 848/1714] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:37.604195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841230f7-e91b-4113-821a-ac2140de59c1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:37.604489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841230f7-e91b-4113-821a-ac2140de59c1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:37.604917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841230f7-e91b-4113-821a-ac2140de59c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:37.628470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-841230f7-e91b-4113-821a-ac2140de59c1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:37.629826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-841230f7-e91b-4113-821a-ac2140de59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:37.639919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 867/1715] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:37.644563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f084691-f682-4800-b273-dbda88e85f8a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:37.655004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f084691-f682-4800-b273-dbda88e85f8a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:37.661259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:37.662044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:37.662354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:37.663249 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:37.664286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:37.664585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:37.666250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:37.680416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 849/1716] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:37.685525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841230f7-e91b-4113-821a-ac2140de59c1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:37.697374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841230f7-e91b-4113-821a-ac2140de59c1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:37.703554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:37.704282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:37.704627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:37.705049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:37.705926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:37.710228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:37.763238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 868/1717] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:37 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:37.769266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:37.780949 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c3b4-a2d3-4e15-a62d-fbb6713ee9e4 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:37.899176 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:37.900272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:37.901701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:37.903496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:37.904791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:37.909891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:37.955973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 850/1718] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:37 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:37.962240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:37.983919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b2974-6b76-4c0a-8852-afa21aa94749 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:37.992743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:37.994086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:37.994744 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:37.995561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:37.996808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.004516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.058487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:38.064648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 869/1719] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:38.075603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1132c-dc77-4d85-84ac-b02099b6e003 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:38.084614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0bc78-5d10-4e8e-9015-48e5c08da018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:38.091351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0bc78-5d10-4e8e-9015-48e5c08da018 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.095349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0bc78-5d10-4e8e-9015-48e5c08da018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.097253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0bc78-5d10-4e8e-9015-48e5c08da018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.111681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0bc78-5d10-4e8e-9015-48e5c08da018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.120388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0bc78-5d10-4e8e-9015-48e5c08da018 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.165799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:38.186584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 851/1720] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:38.190292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca45e-92f3-4ce3-baf2-755017cc0905 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:38.196049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:38.196738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.197016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.197425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] PATH_INFO: `/v3/projects/276f3b55408a4cc9b1e24007f5e58658/users/22e7a4973e024d7f9b9cf1ec8034ce9e/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.217902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] RBAC: Authorizing `identity:create_grant(project_id=276f3b55408a4cc9b1e24007f5e58658, user_id=22e7a4973e024d7f9b9cf1ec8034ce9e, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.221177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.245255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 870/1721] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:38 2022] PUT /identity/v3/projects/276f3b55408a4cc9b1e24007f5e58658/users/22e7a4973e024d7f9b9cf1ec8034ce9e/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:38.266048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9eb31-44d6-491c-9699-36b2cdbf9ed7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.266521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9eb31-44d6-491c-9699-36b2cdbf9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.267006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9eb31-44d6-491c-9699-36b2cdbf9ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.318280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-28a9eb31-44d6-491c-9699-36b2cdbf9ed7 None None] MFA Rules not processed for user `22e7a4973e024d7f9b9cf1ec8034ce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:38.320049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-28a9eb31-44d6-491c-9699-36b2cdbf9ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:38.430118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 852/1722] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:38.436055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:38.498212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:38.539819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3f75-b4d8-4be8-a482-a839dc8a283a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:38.547446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:38.548653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.549125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.549600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.551974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.554541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.605919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 871/1723] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:38 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:38.607462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9eb31-44d6-491c-9699-36b2cdbf9ed7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:38.620142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9eb31-44d6-491c-9699-36b2cdbf9ed7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:38.673884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:38.713218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:38.713218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.713218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.713218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.713693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.715854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.746954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 853/1724] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:38 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:38.748856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:38.762652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57d13a-4d37-46e1-bd58-16fed1f925bd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:38.771215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:38.771872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.772155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.772473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.773129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.774948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.794596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 872/1725] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:38.799631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:38.816868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28cbd4-fa4f-47d9-b2f8-44dce08b3ebf admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:38.824116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9d82a-6439-4233-87c1-865748b890e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:38.825008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d82a-6439-4233-87c1-865748b890e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.825445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d82a-6439-4233-87c1-865748b890e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.825896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9d82a-6439-4233-87c1-865748b890e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.826679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9d82a-6439-4233-87c1-865748b890e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.829852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9d82a-6439-4233-87c1-865748b890e5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.850592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 854/1726] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:38.855515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:38.876728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da216b5e-f1bc-4c9a-8fbd-a68e01abc3cc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:38.885000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:38.885793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.886133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.886465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] PATH_INFO: `/v3/projects/592d1015a5424962ace9a550a9fec10e/users/7c52e67499374f4ca6f43910930fe010/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:38.912020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=592d1015a5424962ace9a550a9fec10e, user_id=7c52e67499374f4ca6f43910930fe010, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:38.915264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:38.938968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 873/1727] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:38 2022] PUT /identity/v3/projects/592d1015a5424962ace9a550a9fec10e/users/7c52e67499374f4ca6f43910930fe010/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:38.957181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4ae5a-3057-408a-b08e-5accda4d402e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:38.957475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4ae5a-3057-408a-b08e-5accda4d402e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:38.957839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4ae5a-3057-408a-b08e-5accda4d402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.012138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d5a4ae5a-3057-408a-b08e-5accda4d402e None None] MFA Rules not processed for user `7c52e67499374f4ca6f43910930fe010`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:39.013733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5a4ae5a-3057-408a-b08e-5accda4d402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:39.142851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 855/1728] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:39.145471 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:39.327847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc7c1-ac8f-4fb9-9a66-8b6737b50f4c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:39.339709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:39.341467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:39.341961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:39.342914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.344935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:39.349156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:39.419424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 874/1729] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:39 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:39.423506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4ae5a-3057-408a-b08e-5accda4d402e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:39.447017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4ae5a-3057-408a-b08e-5accda4d402e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:39.561172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:39.562717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:39.563445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:39.564197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.565495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:39.569074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:39.598334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 856/1730] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:39 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:39.602952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:39.621265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288e021-5eb9-491f-882f-41556f81fbd6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:39.626786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:39.627417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:39.627760 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:39.628034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.628688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:39.630383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:39.650483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 875/1731] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:39.655630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:39.675359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec71b45-8f91-4da3-9fb7-5a31c623077a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:39.682059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:39.683203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:39.683675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:39.684088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] PATH_INFO: `/v3/projects/d5e4f8c1d5d14d6695288d43dbe0dbd2/users/d4b95cfa89ce43aeae7825eab4c89e6b/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.701994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e4f8c1d5d14d6695288d43dbe0dbd2, user_id=d4b95cfa89ce43aeae7825eab4c89e6b, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:39.705705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:39.722013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 857/1732] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:39 2022] PUT /identity/v3/projects/d5e4f8c1d5d14d6695288d43dbe0dbd2/users/d4b95cfa89ce43aeae7825eab4c89e6b/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:39.727014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:39.741315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cf9ed-c7f4-41af-9092-0b788999427d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:39.836775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd5189-3bb9-4be2-a79e-283d050139d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:39.837399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd5189-3bb9-4be2-a79e-283d050139d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:39.838956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd5189-3bb9-4be2-a79e-283d050139d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:39.839435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd5189-3bb9-4be2-a79e-283d050139d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.840576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd5189-3bb9-4be2-a79e-283d050139d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:39.842408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd5189-3bb9-4be2-a79e-283d050139d7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:39.845334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:39.859037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 876/1733] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:39.862866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:39.874260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0adc8-4704-4838-a734-bde614a941a6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:39.879159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:39.879830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:39.880113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:39.880376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] PATH_INFO: `/v3/projects/d5e4f8c1d5d14d6695288d43dbe0dbd2/users/d4b95cfa89ce43aeae7825eab4c89e6b/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.882498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e4f8c1d5d14d6695288d43dbe0dbd2, user_id=d4b95cfa89ce43aeae7825eab4c89e6b, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:39.885255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:39.888644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:39.901542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 858/1734] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:39 2022] PUT /identity/v3/projects/d5e4f8c1d5d14d6695288d43dbe0dbd2/users/d4b95cfa89ce43aeae7825eab4c89e6b/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:39.912364 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:39.912641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:39.912905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:39.946795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] MFA Rules not processed for user `d4b95cfa89ce43aeae7825eab4c89e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:39.948026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:40.040168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 877/1735] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:40.053403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:40.055398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:40.128905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c7308-5774-4d80-9e8f-43aa05967663 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:40.134454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:40.135245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:40.135611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:40.135969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:40.147847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:40.149496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:40.161647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 859/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:40.213165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:40.214807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:40.229211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91fdb-7822-48b0-a68a-a808864f189c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:40.233137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5a4a9-cf79-4e0a-b72f-fe6d9b485a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:40.233887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a4a9-cf79-4e0a-b72f-fe6d9b485a51 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:40.234448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a4a9-cf79-4e0a-b72f-fe6d9b485a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:40.234752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5a4a9-cf79-4e0a-b72f-fe6d9b485a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:40.321839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5a4a9-cf79-4e0a-b72f-fe6d9b485a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:40.338846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5a4a9-cf79-4e0a-b72f-fe6d9b485a51 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:40.341667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 878/1737] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:40.902960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:40.904724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:40.988993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b622-d761-4284-9d7a-4cfc9c00f5b9 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:40.994235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:40.994943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:40.995216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:40.995521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] PATH_INFO: `/v3/users/2724de2ebfbd44399f598b06dec39a4a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:40.997442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2724de2ebfbd44399f598b06dec39a4a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:40.999622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:41.061761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2724de2ebfbd44399f598b06dec39a4a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:41.062469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2724de2ebfbd44399f598b06dec39a4a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:41.079760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2724de2ebfbd44399f598b06dec39a4a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:41.106933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2724de2ebfbd44399f598b06dec39a4a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:41.108454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2724de2ebfbd44399f598b06dec39a4a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:41.127240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 860/1738] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:40 2022] DELETE /identity/v3/users/2724de2ebfbd44399f598b06dec39a4a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:41.132050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:41.132545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:41.132636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:41.163697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:41.165955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:41.286756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 879/1739] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:41.297386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:41.299146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:41.343077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:41.400795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbafac-2226-4b8b-b3f5-c26aa834a9cb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:41.408334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:41.409431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:41.409916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:41.410395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:41.428518 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:41.431406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:41.452482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 861/1740] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:41.823988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:41.825719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:41.862998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63884dff-6c51-4c77-9916-76c39ee22136 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:41.868043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:41.868951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:41.870371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:41.870850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] PATH_INFO: `/v3/projects/08a27336afad4eb892797af74b1ebb38` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:41.872612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a27336afad4eb892797af74b1ebb38)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:41.874956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:41.901830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:41.953307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a27336afad4eb892797af74b1ebb38', 'request_id': 'req-30d3e6ea-8dfe-4762-8498-b56c649e2518'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:41.965592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a27336afad4eb892797af74b1ebb38', 'request_id': 'req-30d3e6ea-8dfe-4762-8498-b56c649e2518'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:41.983258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a27336afad4eb892797af74b1ebb38', 'request_id': 'req-30d3e6ea-8dfe-4762-8498-b56c649e2518'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.025095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] The token cache is being invalidate because project 08a27336afad4eb892797af74b1ebb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:42.025487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.027760 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.029550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 880/1741] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:41 2022] DELETE /identity/v3/projects/08a27336afad4eb892797af74b1ebb38 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:42.034059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:42.047444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e10e5a-434a-453e-84a3-65129e72cb98 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:42.116485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:42.117127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:42.117377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:42.117735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] PATH_INFO: `/v3/users/03016ec200c14eab926e12a1dd86fbb2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:42.120364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=03016ec200c14eab926e12a1dd86fbb2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:42.124791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:42.195961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03016ec200c14eab926e12a1dd86fbb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.196673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03016ec200c14eab926e12a1dd86fbb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.215905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03016ec200c14eab926e12a1dd86fbb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.228529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03016ec200c14eab926e12a1dd86fbb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.229523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-33ec0d3b-39be-4ce7-9420-64b914b237ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03016ec200c14eab926e12a1dd86fbb2'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.252646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 862/1742] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:42 2022] DELETE /identity/v3/users/03016ec200c14eab926e12a1dd86fbb2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:42.665646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:42.667268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:42.684797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e6ea-8dfe-4762-8498-b56c649e2518 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:42.757297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:42.757948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:42.758226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:42.758499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] PATH_INFO: `/v3/projects/b3b9ff8fc2b141f499f2ecc5fd57cc6b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:42.759733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b9ff8fc2b141f499f2ecc5fd57cc6b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:42.763708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:42.825359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b9ff8fc2b141f499f2ecc5fd57cc6b', 'request_id': 'req-606f073b-56cc-4227-b8a9-22ce526629a8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.837281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b9ff8fc2b141f499f2ecc5fd57cc6b', 'request_id': 'req-606f073b-56cc-4227-b8a9-22ce526629a8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.847628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b9ff8fc2b141f499f2ecc5fd57cc6b', 'request_id': 'req-606f073b-56cc-4227-b8a9-22ce526629a8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.859389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] The token cache is being invalidate because project b3b9ff8fc2b141f499f2ecc5fd57cc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:42.859672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.860320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-606f073b-56cc-4227-b8a9-22ce526629a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:42.861933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 881/1743] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:42 2022] DELETE /identity/v3/projects/b3b9ff8fc2b141f499f2ecc5fd57cc6b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:42.868156 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a286-4801-40d7-91ee-cc7d86152e51 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:42.868474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a286-4801-40d7-91ee-cc7d86152e51 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:42.868755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a286-4801-40d7-91ee-cc7d86152e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:42.894710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6518a286-4801-40d7-91ee-cc7d86152e51 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:42.896778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6518a286-4801-40d7-91ee-cc7d86152e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:42.948576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:42.984282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 863/1744] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:42.994173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd12ea2-a670-4336-bf35-466d3c21e1cb None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:42.994591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd12ea2-a670-4336-bf35-466d3c21e1cb None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:42.995073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd12ea2-a670-4336-bf35-466d3c21e1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.019999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cbd12ea2-a670-4336-bf35-466d3c21e1cb None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:43.021264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cbd12ea2-a670-4336-bf35-466d3c21e1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:43.034906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 882/1745] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:43.040281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a286-4801-40d7-91ee-cc7d86152e51 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.056709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a286-4801-40d7-91ee-cc7d86152e51 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.062698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.063898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.064416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.064650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.065595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:43.066036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.067930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.084604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 864/1746] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:43.086388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd12ea2-a670-4336-bf35-466d3c21e1cb None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.097021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd12ea2-a670-4336-bf35-466d3c21e1cb None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.103824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.105066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.105066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.105400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.105957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.110960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.170121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.170969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 883/1747] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:43 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:43.187413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e267173-4b6c-4e6b-b102-fca6e460f12c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.275586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.276130 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.276404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.276677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.277342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.279398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.304262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 865/1748] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:43 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:43.308436 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.320682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289398a-7357-4bc4-b72d-a6d7b6cca878 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.325677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.326298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.326619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.326893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.327539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.329127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.330686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:43.341568 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 884/1749] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:43.345282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.356173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858c360-977c-4a54-bfe6-3396de0e45af admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.361359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f43804-73b7-43a4-9138-70e0a413d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.361967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43804-73b7-43a4-9138-70e0a413d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.362244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43804-73b7-43a4-9138-70e0a413d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.362585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f43804-73b7-43a4-9138-70e0a413d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.363188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f43804-73b7-43a4-9138-70e0a413d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.364822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f43804-73b7-43a4-9138-70e0a413d9e5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.376399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 866/1750] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:43.380893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.391900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fb32c-36cf-4e3b-9231-8e3eeab01ffd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.398676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.399299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.399708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.399807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] PATH_INFO: `/v3/projects/4875a3b5165146b5a3671f1b8c82bd9c/users/381f7c43451f4da39ced3b45077be385/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.417793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4875a3b5165146b5a3671f1b8c82bd9c, user_id=381f7c43451f4da39ced3b45077be385, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.420612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.438224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 885/1751] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:43 2022] PUT /identity/v3/projects/4875a3b5165146b5a3671f1b8c82bd9c/users/381f7c43451f4da39ced3b45077be385/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:43.448573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075041e6-f483-4b4b-9c86-4846d0d2ae89 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.448859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075041e6-f483-4b4b-9c86-4846d0d2ae89 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.449120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075041e6-f483-4b4b-9c86-4846d0d2ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.484584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-075041e6-f483-4b4b-9c86-4846d0d2ae89 None None] MFA Rules not processed for user `381f7c43451f4da39ced3b45077be385`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:43.485825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-075041e6-f483-4b4b-9c86-4846d0d2ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:43.577343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.580259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:43.594030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 867/1752] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:43.603064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075041e6-f483-4b4b-9c86-4846d0d2ae89 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.644798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:43.653994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27bf29-e84c-4418-97e5-f364c8d7b386 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.658853 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.659550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.659826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.660093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] PATH_INFO: `/v3/users/22e7a4973e024d7f9b9cf1ec8034ce9e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.661382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e7a4973e024d7f9b9cf1ec8034ce9e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.663969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.674535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075041e6-f483-4b4b-9c86-4846d0d2ae89 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.679226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.679836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.680115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.680383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.681016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.682972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.714890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 868/1753] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:43 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:43.715950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.716242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e7a4973e024d7f9b9cf1ec8034ce9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:43.717407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e7a4973e024d7f9b9cf1ec8034ce9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:43.725009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e7a4973e024d7f9b9cf1ec8034ce9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:43.735052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e7a4973e024d7f9b9cf1ec8034ce9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:43.749528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8d535c05-f82e-428b-b653-39e8df178601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e7a4973e024d7f9b9cf1ec8034ce9e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:43.756373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 886/1754] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:43 2022] DELETE /identity/v3/users/22e7a4973e024d7f9b9cf1ec8034ce9e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:43.760843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.761122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.761385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.780101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:43.781420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:43.784852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee642d-546b-43aa-8097-a4dacfb437ff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.827779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:43.845009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 887/1755] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:43.847121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.847740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.848021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.848292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.849371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.850868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.855093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.856511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:43.873776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 869/1756] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:43 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:43.878021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.879799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:43.892293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6bef-ad8c-4de1-a65b-82f22fabbdb3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.897373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.897929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.898211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.898475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.899146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.900778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.912583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 870/1757] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:43.917375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.928021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecb8eb-c1a1-4e8f-8752-9fe16691d719 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.928583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b6951-3325-4d9d-98ea-2de6a8587028 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:43.932570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29065530-1482-43f9-8675-768689de4682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.932843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:43.933217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065530-1482-43f9-8675-768689de4682 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.933510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065530-1482-43f9-8675-768689de4682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.933610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:43.933774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065530-1482-43f9-8675-768689de4682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.933867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:43.934080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] PATH_INFO: `/v3/projects/9117ee429d3a4b529f3fc29c747cc09c/users/15d5818914ab49c9a1e7730393352806/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:43.944163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29065530-1482-43f9-8675-768689de4682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.945642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29065530-1482-43f9-8675-768689de4682 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.951449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9117ee429d3a4b529f3fc29c747cc09c, user_id=15d5818914ab49c9a1e7730393352806, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:43.955227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:43.956675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 888/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:43.970975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 871/1759] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:43 2022] PUT /identity/v3/projects/9117ee429d3a4b529f3fc29c747cc09c/users/15d5818914ab49c9a1e7730393352806/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:43.979029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29065530-1482-43f9-8675-768689de4682 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:43.990454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29065530-1482-43f9-8675-768689de4682 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:44.065291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b3dee-a207-45ed-bdc2-80d4b2ecde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:44.065952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b3dee-a207-45ed-bdc2-80d4b2ecde4e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:44.066229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b3dee-a207-45ed-bdc2-80d4b2ecde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:44.066523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b3dee-a207-45ed-bdc2-80d4b2ecde4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:44.067256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b3dee-a207-45ed-bdc2-80d4b2ecde4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:44.068899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b3dee-a207-45ed-bdc2-80d4b2ecde4e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:44.094129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 889/1760] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:44.095790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:44.107667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a55746-503a-4e84-976b-36ddbb21d0f7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:44.112679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:44.113349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:44.113659 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:44.113914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] PATH_INFO: `/v3/projects/9117ee429d3a4b529f3fc29c747cc09c/users/15d5818914ab49c9a1e7730393352806/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:44.115914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9117ee429d3a4b529f3fc29c747cc09c, user_id=15d5818914ab49c9a1e7730393352806, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:44.118611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:44.142507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:44.142752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:44.142911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:44.146509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 872/1761] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:44 2022] PUT /identity/v3/projects/9117ee429d3a4b529f3fc29c747cc09c/users/15d5818914ab49c9a1e7730393352806/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:44.179126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] MFA Rules not processed for user `15d5818914ab49c9a1e7730393352806`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:44.179953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:44.268007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 890/1762] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:44.278900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:44.281827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:44.294131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:44.296397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:44.301257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:44.325824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:44.422529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ed40-7d06-45fb-94c2-5cdb3219e7d1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:44.429881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:44.430856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:44.431246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:44.431528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] PATH_INFO: `/v3/projects/276f3b55408a4cc9b1e24007f5e58658` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:44.432879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276f3b55408a4cc9b1e24007f5e58658)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:44.435721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:44.445579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964c070-60aa-4645-97e8-7a195263c63b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:44.452012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:44.452926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:44.453285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:44.453639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:44.466821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:44.470806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:44.486527 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 873/1763] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:44.500929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276f3b55408a4cc9b1e24007f5e58658', 'request_id': 'req-f41d058c-cecc-4bec-9eab-b2a910bcf310'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.508517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276f3b55408a4cc9b1e24007f5e58658', 'request_id': 'req-f41d058c-cecc-4bec-9eab-b2a910bcf310'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.520066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276f3b55408a4cc9b1e24007f5e58658', 'request_id': 'req-f41d058c-cecc-4bec-9eab-b2a910bcf310'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.559398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] The token cache is being invalidate because project 276f3b55408a4cc9b1e24007f5e58658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:44.559398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.562256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.565688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 891/1764] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:44 2022] DELETE /identity/v3/projects/276f3b55408a4cc9b1e24007f5e58658 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:44.572452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:44.595534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4d77c-d254-4911-871c-857d8f87a840 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:44.793179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:44.794269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:44.794724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:44.795144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] PATH_INFO: `/v3/users/7c52e67499374f4ca6f43910930fe010` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:44.796564 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c52e67499374f4ca6f43910930fe010)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:44.799733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:44.902760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c52e67499374f4ca6f43910930fe010'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.903679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c52e67499374f4ca6f43910930fe010'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.922131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c52e67499374f4ca6f43910930fe010'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.930874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c52e67499374f4ca6f43910930fe010'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.932065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c52e67499374f4ca6f43910930fe010'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:44.954854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 874/1765] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:44 2022] DELETE /identity/v3/users/7c52e67499374f4ca6f43910930fe010 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:45.115864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:45.117832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:45.139581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d058c-cecc-4bec-9eab-b2a910bcf310 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:45.229745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:45.230523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:45.230901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:45.231119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] PATH_INFO: `/v3/users/381f7c43451f4da39ced3b45077be385` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:45.232527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=381f7c43451f4da39ced3b45077be385)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:45.234525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:45.310895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381f7c43451f4da39ced3b45077be385'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.311682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381f7c43451f4da39ced3b45077be385'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.313448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:45.324687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381f7c43451f4da39ced3b45077be385'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.329020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:45.331041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:45.337352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381f7c43451f4da39ced3b45077be385'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.354626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a98a7-017e-4b50-9b04-e0c61e4de2bc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:45.362303 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:45.363219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:45.363676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:45.364168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] PATH_INFO: `/v3/projects/592d1015a5424962ace9a550a9fec10e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:45.366692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592d1015a5424962ace9a550a9fec10e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:45.366911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f20bb004-5d99-43c2-8450-f6897ecb03ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381f7c43451f4da39ced3b45077be385'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.370344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:45.376848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 892/1766] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:45 2022] DELETE /identity/v3/users/381f7c43451f4da39ced3b45077be385 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:45.382751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:45.383037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:45.383334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:45.409435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:45.411714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:45.417917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:45.452035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592d1015a5424962ace9a550a9fec10e', 'request_id': 'req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.460595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592d1015a5424962ace9a550a9fec10e', 'request_id': 'req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.473037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592d1015a5424962ace9a550a9fec10e', 'request_id': 'req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.495627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] The token cache is being invalidate because project 592d1015a5424962ace9a550a9fec10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:45.496193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.497567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.500561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 875/1767] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:45 2022] DELETE /identity/v3/projects/592d1015a5424962ace9a550a9fec10e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:45.506925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:45.509208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:45.514700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 893/1768] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:45.527872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:45.529650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:45.618878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217559-2fbd-466f-87f6-e328fc35c9d4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:45.635473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8aeb09-7692-47f2-9d2d-a8c50e016f98 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:45.644715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:45.645749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:45.646185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:45.646722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] PATH_INFO: `/v3/users/d4b95cfa89ce43aeae7825eab4c89e6b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:45.648308 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b95cfa89ce43aeae7825eab4c89e6b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:45.652209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:45.710163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:45.711535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:45.711965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:45.712471 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:45.733197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:45.736029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:45.743253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b95cfa89ce43aeae7825eab4c89e6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.744489 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b95cfa89ce43aeae7825eab4c89e6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.770862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 894/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:45.779365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b95cfa89ce43aeae7825eab4c89e6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.789139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b95cfa89ce43aeae7825eab4c89e6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.790418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b95cfa89ce43aeae7825eab4c89e6b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:45.819709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 876/1770] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:45 2022] DELETE /identity/v3/users/d4b95cfa89ce43aeae7825eab4c89e6b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:46.329016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:46.330789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:46.332442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:46.358848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adabafb-f2fe-4bc9-9ad0-e5a5ff3e5a77 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:46.394433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:46.419341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:46.467712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7bc8-1b6c-48e1-b0b4-4a10fffc563d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:46.472031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:46.473165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:46.473285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:46.473652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:46.473875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:46.474133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] PATH_INFO: `/v3/projects/d5e4f8c1d5d14d6695288d43dbe0dbd2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:46.474241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:46.474402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] PATH_INFO: `/v3/projects/4875a3b5165146b5a3671f1b8c82bd9c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:46.475666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4875a3b5165146b5a3671f1b8c82bd9c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:46.476188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e4f8c1d5d14d6695288d43dbe0dbd2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:46.477666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:46.480050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:46.548308 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4875a3b5165146b5a3671f1b8c82bd9c', 'request_id': 'req-bc7efb5e-1e7c-4377-8378-a6e4412334ff'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.558591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4875a3b5165146b5a3671f1b8c82bd9c', 'request_id': 'req-bc7efb5e-1e7c-4377-8378-a6e4412334ff'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.562304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e4f8c1d5d14d6695288d43dbe0dbd2', 'request_id': 'req-b791ad2d-e832-43bf-a873-c816d34ff75b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.570466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4875a3b5165146b5a3671f1b8c82bd9c', 'request_id': 'req-bc7efb5e-1e7c-4377-8378-a6e4412334ff'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.573299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e4f8c1d5d14d6695288d43dbe0dbd2', 'request_id': 'req-b791ad2d-e832-43bf-a873-c816d34ff75b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.585472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e4f8c1d5d14d6695288d43dbe0dbd2', 'request_id': 'req-b791ad2d-e832-43bf-a873-c816d34ff75b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.593280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] The token cache is being invalidate because project 4875a3b5165146b5a3671f1b8c82bd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:46.593968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.594465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.596599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 877/1771] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:46 2022] DELETE /identity/v3/projects/4875a3b5165146b5a3671f1b8c82bd9c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:46.601884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:46.603766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:46.606350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] The token cache is being invalidate because project d5e4f8c1d5d14d6695288d43dbe0dbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:46.606934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.608024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b791ad2d-e832-43bf-a873-c816d34ff75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.611903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 895/1772] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:46 2022] DELETE /identity/v3/projects/d5e4f8c1d5d14d6695288d43dbe0dbd2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:46.623741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206833-a96f-4d59-b705-dd7809d9a879 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:46.624213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206833-a96f-4d59-b705-dd7809d9a879 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:46.624631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a206833-a96f-4d59-b705-dd7809d9a879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:46.652814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2a206833-a96f-4d59-b705-dd7809d9a879 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:46.654941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2a206833-a96f-4d59-b705-dd7809d9a879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:46.706528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7efb5e-1e7c-4377-8378-a6e4412334ff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:46.759827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 896/1773] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:46.770518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ace5-6cf7-40a0-97de-f0e90c60c15c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:46.770829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ace5-6cf7-40a0-97de-f0e90c60c15c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:46.771113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ace5-6cf7-40a0-97de-f0e90c60c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:46.794109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-13a6ace5-6cf7-40a0-97de-f0e90c60c15c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:46.795416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-13a6ace5-6cf7-40a0-97de-f0e90c60c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:46.810510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 897/1774] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:46.811605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:46.811827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ace5-6cf7-40a0-97de-f0e90c60c15c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:46.813059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:46.813637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:46.814754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] PATH_INFO: `/v3/users/15d5818914ab49c9a1e7730393352806` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:46.822190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ace5-6cf7-40a0-97de-f0e90c60c15c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:46.824049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d5818914ab49c9a1e7730393352806)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:46.827749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:46.828401 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:46.828597 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:46.828768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:46.828928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:46.829640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:46.829962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:46.831754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:46.853386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 898/1775] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:46.858775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:46.859024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:46.888145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6ae1f-a45d-4a0d-bd27-85cad7494b06 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:46.897339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:46.899702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:46.900198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:46.900724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:46.902048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:46.911850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:46.917811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d5818914ab49c9a1e7730393352806'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.919047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d5818914ab49c9a1e7730393352806'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.937581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d5818914ab49c9a1e7730393352806'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.950060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d5818914ab49c9a1e7730393352806'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.951332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d5818914ab49c9a1e7730393352806'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:46.992337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 878/1776] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:46 2022] DELETE /identity/v3/users/15d5818914ab49c9a1e7730393352806 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:01:47.029992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 899/1777] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:46 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:47.031816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:47.034706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:47.160355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc71e2f-cf18-46a4-93d5-02216351751d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:47.283947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:47.285266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.286078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.286759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.288980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:47.297589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:47.336019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 879/1778] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:47 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:47.338155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:47.357415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730a2c3-f4f7-4e8b-8660-5d7a2e7350a4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:47.365702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:47.366941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.367445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.367933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.369239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:47.372862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:47.389779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 900/1779] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:47.394179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:47.406057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044d36e-b5be-486f-8daf-a5dbfadf240e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:47.417901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f037286-8a39-48de-bd45-4faa4a4a7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:47.419369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f037286-8a39-48de-bd45-4faa4a4a7ede admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.420079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f037286-8a39-48de-bd45-4faa4a4a7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.420721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f037286-8a39-48de-bd45-4faa4a4a7ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.422053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f037286-8a39-48de-bd45-4faa4a4a7ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:47.425990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f037286-8a39-48de-bd45-4faa4a4a7ede admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:47.445645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 880/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:47.449962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:47.458351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:47.465831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e45ea-dd70-4273-a056-4724dedd0cc7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:47.475597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:47.476650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.477244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.477806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] PATH_INFO: `/v3/projects/10066a43afdd42b1b7f7b4595d123b55/users/c62f038ebf9b4633a30c39b39532e570/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.497021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10066a43afdd42b1b7f7b4595d123b55, user_id=c62f038ebf9b4633a30c39b39532e570, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:47.500314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:47.524766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 901/1781] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:47 2022] PUT /identity/v3/projects/10066a43afdd42b1b7f7b4595d123b55/users/c62f038ebf9b4633a30c39b39532e570/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:47.538997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.539310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.539915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.561818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:47.564841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:47.574677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] MFA Rules not processed for user `c62f038ebf9b4633a30c39b39532e570`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:47.575859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:47.580495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:47.683685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26b6ab-cf96-4c17-8a25-89e7b1d41c89 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:47.693228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:47.693903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.694178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.694440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] PATH_INFO: `/v3/projects/9117ee429d3a4b529f3fc29c747cc09c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.696454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9117ee429d3a4b529f3fc29c747cc09c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:47.702680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:47.732973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 881/1782] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:47.758276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:47.760016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:47.803824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9117ee429d3a4b529f3fc29c747cc09c', 'request_id': 'req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:47.816347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9117ee429d3a4b529f3fc29c747cc09c', 'request_id': 'req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:47.829885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9117ee429d3a4b529f3fc29c747cc09c', 'request_id': 'req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:47.852496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] The token cache is being invalidate because project 9117ee429d3a4b529f3fc29c747cc09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:47.852888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:47.854232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e6d5751e-ebeb-4b81-aa0c-c25dff9c7baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:47.856959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 902/1783] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:47 2022] DELETE /identity/v3/projects/9117ee429d3a4b529f3fc29c747cc09c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:47.857276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab62dd-f84b-4575-8ea0-b1fd09db69f3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:47.865374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcdfcb-10cb-49d7-b58d-3a5f3ade3112 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.865926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcdfcb-10cb-49d7-b58d-3a5f3ade3112 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.866141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcdfcb-10cb-49d7-b58d-3a5f3ade3112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.901455 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6ddcdfcb-10cb-49d7-b58d-3a5f3ade3112 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:47.902967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6ddcdfcb-10cb-49d7-b58d-3a5f3ade3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:47.931165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:47.931807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:47.932086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:47.932356 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:47.935594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.047993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.049691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 903/1784] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:48.050508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.070468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf729-9fd4-4f02-99a1-127942131227 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.070468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf729-9fd4-4f02-99a1-127942131227 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.070468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf729-9fd4-4f02-99a1-127942131227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.083972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 882/1785] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:48.100457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1a5bf729-9fd4-4f02-99a1-127942131227 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:48.101833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1a5bf729-9fd4-4f02-99a1-127942131227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.115877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 904/1786] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:48.119351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.121378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.129039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf729-9fd4-4f02-99a1-127942131227 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.138964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:48.140797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a130dc-b068-4954-abd3-b0744eebb57a service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.147378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.148675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.149414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.149767 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf729-9fd4-4f02-99a1-127942131227 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.149893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] PATH_INFO: `/v3/users/c62f038ebf9b4633a30c39b39532e570` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.151515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62f038ebf9b4633a30c39b39532e570)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.154042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.164426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.166293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.167515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.168276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.169426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:48.170260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:48.170971 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.173381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.197739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 905/1787] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:48.199126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.210999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c94bc-3ab5-4a3e-b883-ebe7258e519a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.217642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.218296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.218719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.218982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.219774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.222403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.251591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62f038ebf9b4633a30c39b39532e570'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:48.252888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62f038ebf9b4633a30c39b39532e570'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:48.259119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 906/1788] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:48 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:48.264941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.278327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62f038ebf9b4633a30c39b39532e570'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:48.298441 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62f038ebf9b4633a30c39b39532e570'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:48.300014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5963dd1b-d12f-4668-b883-6ad4c34db1b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62f038ebf9b4633a30c39b39532e570'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:48.322040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 883/1789] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:48 2022] DELETE /identity/v3/users/c62f038ebf9b4633a30c39b39532e570 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:48.324963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.324963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.324963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.347847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:48.349301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.369289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c7484-cab2-47a9-b37f-70f3190417ec admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.448476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 884/1790] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:48.463310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.463628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.464738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.465145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.465304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.465748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.467227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.471232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.514843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 907/1791] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:48 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:48.514843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.523672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.530242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988f190-de5d-4518-89e9-7441d824811f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.537554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.538187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.538806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.539080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.539741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.541450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.553265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fe1f0-3b8e-4686-9724-f591186b463c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.557133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.557750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.558028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.558295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.561929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 908/1792] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:48.564007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.574227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.576731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.580308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3144fd-c2ad-4014-a4bd-16dbfd8c6114 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.588420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ed3d2-1e31-4100-893a-1a32590361b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.589346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed3d2-1e31-4100-893a-1a32590361b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.589805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed3d2-1e31-4100-893a-1a32590361b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.590896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed3d2-1e31-4100-893a-1a32590361b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.591814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ed3d2-1e31-4100-893a-1a32590361b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.593731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ed3d2-1e31-4100-893a-1a32590361b7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.594974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 885/1793] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:48.610733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 909/1794] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:48.616102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.636155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8e5d9-597c-4e30-9f35-63065ac7e7b9 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.646789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.647937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.648278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.648715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] PATH_INFO: `/v3/projects/9776892b4c294a6899025248605a2cea/users/0dc9915912284e368230b01f90fe8aeb/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.675720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9776892b4c294a6899025248605a2cea, user_id=0dc9915912284e368230b01f90fe8aeb, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.678687 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.696039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 886/1795] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:48 2022] PUT /identity/v3/projects/9776892b4c294a6899025248605a2cea/users/0dc9915912284e368230b01f90fe8aeb/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:48.714100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.714426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.714757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.758070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] MFA Rules not processed for user `0dc9915912284e368230b01f90fe8aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:48.760249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.813831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:48.860075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 910/1796] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:48.873014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:48.875469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:48.887606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:48.957040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcf38-5a66-4312-ba40-102c544af115 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:48.960870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bdba7-fff4-4e4a-88e0-c6e7924f5331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:48.961532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bdba7-fff4-4e4a-88e0-c6e7924f5331 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:48.961802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bdba7-fff4-4e4a-88e0-c6e7924f5331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:48.962067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bdba7-fff4-4e4a-88e0-c6e7924f5331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:48.973099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bdba7-fff4-4e4a-88e0-c6e7924f5331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:48.974714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bdba7-fff4-4e4a-88e0-c6e7924f5331 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:48.985815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 887/1797] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:49.016767 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.019144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:49.118361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd47f5a-d842-419b-bab3-968178b1ee33 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.125642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.126259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.126574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.127237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] PATH_INFO: `/v3/projects/10066a43afdd42b1b7f7b4595d123b55` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.128150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10066a43afdd42b1b7f7b4595d123b55)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.130580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.212159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10066a43afdd42b1b7f7b4595d123b55', 'request_id': 'req-2829963f-4fc3-4dd3-84d3-695ae107752a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:49.220813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10066a43afdd42b1b7f7b4595d123b55', 'request_id': 'req-2829963f-4fc3-4dd3-84d3-695ae107752a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:49.229582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10066a43afdd42b1b7f7b4595d123b55', 'request_id': 'req-2829963f-4fc3-4dd3-84d3-695ae107752a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:49.245450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] The token cache is being invalidate because project 10066a43afdd42b1b7f7b4595d123b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:49.246012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:49.247263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2829963f-4fc3-4dd3-84d3-695ae107752a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:49.252860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 911/1798] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:49 2022] DELETE /identity/v3/projects/10066a43afdd42b1b7f7b4595d123b55 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:49.255655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d6a49-409e-4fbb-8720-a2d511ec62e8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.255943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d6a49-409e-4fbb-8720-a2d511ec62e8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.256212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d6a49-409e-4fbb-8720-a2d511ec62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.281130 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7a7d6a49-409e-4fbb-8720-a2d511ec62e8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:49.282901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7a7d6a49-409e-4fbb-8720-a2d511ec62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:49.375251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 888/1799] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:49.384321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b208a-fdd4-4081-b511-ec4b371e39d8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.384823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b208a-fdd4-4081-b511-ec4b371e39d8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.384909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b208a-fdd4-4081-b511-ec4b371e39d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.408546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3c4b208a-fdd4-4081-b511-ec4b371e39d8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:49.409791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3c4b208a-fdd4-4081-b511-ec4b371e39d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:49.420451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 912/1800] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:49.424861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d6a49-409e-4fbb-8720-a2d511ec62e8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.436602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d6a49-409e-4fbb-8720-a2d511ec62e8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.441750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.442512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.442956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.443222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.443910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:49.444209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.446082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.459877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 889/1801] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:49.466648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b208a-fdd4-4081-b511-ec4b371e39d8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.477554 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b208a-fdd4-4081-b511-ec4b371e39d8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.487340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.488213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.488638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.489030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.489854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.492121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.535126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 913/1802] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:49 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:49.541088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.560396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ee12e-546b-475e-8b52-354d559b8d63 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.590990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.595954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:49.682739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:49.703467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.705438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.706311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.706621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.707683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.711251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.739046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744a5ac-a6be-48a0-b0cf-4b49261c5793 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.748812 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 890/1803] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:49 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:49.750895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.752077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.752390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.752659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.754938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:49.755556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.773348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e5e7f-2e5c-4638-832d-7b42aa6d4d8a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.781703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.783501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.783937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.784356 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.785806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.788952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.808410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 891/1804] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:49.815698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.832830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d9c67-62f8-4e96-b1fe-665e80c3d3de admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.841548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19f143-da0e-4170-be51-61e609f79ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.842663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19f143-da0e-4170-be51-61e609f79ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.843152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19f143-da0e-4170-be51-61e609f79ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.843617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19f143-da0e-4170-be51-61e609f79ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.844777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19f143-da0e-4170-be51-61e609f79ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.845085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.846523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.847866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19f143-da0e-4170-be51-61e609f79ae2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.859019 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 914/1805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:49.869486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 892/1806] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:01:49.874447 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:49.889441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446fd2-c577-46d8-89aa-e218a1241828 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:49.896757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:49.896757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.896757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.896757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] PATH_INFO: `/v3/projects/83cfd51cb48f4af4896a5e4a61389e6d/users/e416a0a02d8e460494d6545c35096d7e/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.923801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cfd51cb48f4af4896a5e4a61389e6d, user_id=e416a0a02d8e460494d6545c35096d7e, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:49.927854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:49.945499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 915/1807] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:49 2022] PUT /identity/v3/projects/83cfd51cb48f4af4896a5e4a61389e6d/users/e416a0a02d8e460494d6545c35096d7e/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:49.950821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ed06-ce07-4fd4-bdb8-585c5835f5dc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:49.951126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ed06-ce07-4fd4-bdb8-585c5835f5dc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:49.951404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ed06-ce07-4fd4-bdb8-585c5835f5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:49.960220 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:49.974667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-af43ed06-ce07-4fd4-bdb8-585c5835f5dc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:49.976179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-af43ed06-ce07-4fd4-bdb8-585c5835f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:50.060906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 893/1808] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:50.073976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:50.076679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:50.147302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b7b64-b41e-4e84-a46a-797443941b35 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:50.151695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:50.152367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:50.152744 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:50.152968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:50.164790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:50.166068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:50.178986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 916/1809] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:51.169062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:51.169617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:51.170028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:51.224605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] MFA Rules not processed for user `e416a0a02d8e460494d6545c35096d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:51.227071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:51.345797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 894/1810] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:51.362868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:51.448306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fc457-9c0d-439b-80e6-8cc5cf626cb5 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:51.452893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528583ce-5329-4b58-a2e5-6f9e412dbc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:51.453646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528583ce-5329-4b58-a2e5-6f9e412dbc05 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:51.455081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528583ce-5329-4b58-a2e5-6f9e412dbc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:51.455081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528583ce-5329-4b58-a2e5-6f9e412dbc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:51.467456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528583ce-5329-4b58-a2e5-6f9e412dbc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:51.469457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528583ce-5329-4b58-a2e5-6f9e412dbc05 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:51.482395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 917/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:51.861629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:51.864607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:51.895030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb9131-a470-4a44-9c5e-d76b119ec93d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:51.918525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:51.918525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:51.918525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:51.918525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] PATH_INFO: `/v3/users/0dc9915912284e368230b01f90fe8aeb` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:51.919346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc9915912284e368230b01f90fe8aeb)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:51.919346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:52.010840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc9915912284e368230b01f90fe8aeb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:52.011552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc9915912284e368230b01f90fe8aeb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:52.030911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc9915912284e368230b01f90fe8aeb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:52.045424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc9915912284e368230b01f90fe8aeb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:52.046938 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc9915912284e368230b01f90fe8aeb'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:52.071191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 895/1812] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:51 2022] DELETE /identity/v3/users/0dc9915912284e368230b01f90fe8aeb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:52.078456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:52.079086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:52.079717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:52.094780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:52.113802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:52.115845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:52.221835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 918/1813] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:52.234388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:52.236004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:52.247073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:52.320663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352758f8-09c0-4ef0-9c90-f207b130a1de admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:52.325007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f0a02-040e-49e8-819a-60b4888e0146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:52.325749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f0a02-040e-49e8-819a-60b4888e0146 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:52.326022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f0a02-040e-49e8-819a-60b4888e0146 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:52.326292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f0a02-040e-49e8-819a-60b4888e0146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:52.353494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f0a02-040e-49e8-819a-60b4888e0146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:52.356243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f0a02-040e-49e8-819a-60b4888e0146 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:52.372234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 896/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:52.865968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:52.868717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:52.891559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de926b-df01-4faf-8643-59e55b89ebfc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:52.900551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:52.900551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:52.900551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:52.900551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] PATH_INFO: `/v3/projects/9776892b4c294a6899025248605a2cea` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:52.901249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9776892b4c294a6899025248605a2cea)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:52.902340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:53.016485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9776892b4c294a6899025248605a2cea', 'request_id': 'req-f4a1c224-4135-43de-a605-b576c8174312'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:53.032243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9776892b4c294a6899025248605a2cea', 'request_id': 'req-f4a1c224-4135-43de-a605-b576c8174312'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:53.048357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9776892b4c294a6899025248605a2cea', 'request_id': 'req-f4a1c224-4135-43de-a605-b576c8174312'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:53.106299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] The token cache is being invalidate because project 9776892b4c294a6899025248605a2cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:53.107215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:53.109067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f4a1c224-4135-43de-a605-b576c8174312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:53.111931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 919/1815] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:52 2022] DELETE /identity/v3/projects/9776892b4c294a6899025248605a2cea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:53.119615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db7897-30fc-4f07-83ba-a6f6097e99d7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.120305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db7897-30fc-4f07-83ba-a6f6097e99d7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.120921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db7897-30fc-4f07-83ba-a6f6097e99d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.141461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048694e-eae9-455d-b4da-884d634933be None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.141925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048694e-eae9-455d-b4da-884d634933be None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.142355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048694e-eae9-455d-b4da-884d634933be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.154341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c4db7897-30fc-4f07-83ba-a6f6097e99d7 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:53.156242 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c4db7897-30fc-4f07-83ba-a6f6097e99d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:53.176472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8048694e-eae9-455d-b4da-884d634933be None None] MFA Rules not processed for user `e416a0a02d8e460494d6545c35096d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:53.178332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8048694e-eae9-455d-b4da-884d634933be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:53.260654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 897/1816] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:53.265692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c4d2-781a-47d3-be4b-4dd0096fa3d5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.266200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c4d2-781a-47d3-be4b-4dd0096fa3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.266534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238c4d2-781a-47d3-be4b-4dd0096fa3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.292531 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 920/1817] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:53.300528 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3238c4d2-781a-47d3-be4b-4dd0096fa3d5 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:53.303180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3238c4d2-781a-47d3-be4b-4dd0096fa3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:53.316865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 898/1818] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:53.326350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048694e-eae9-455d-b4da-884d634933be None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:53.339240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048694e-eae9-455d-b4da-884d634933be None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:53.354459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:53.356611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.359000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.359000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.359800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:53.360060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:53.365313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:53.391650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 921/1819] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:01:53.394099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c4d2-781a-47d3-be4b-4dd0096fa3d5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:53.410433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238c4d2-781a-47d3-be4b-4dd0096fa3d5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:53.435653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:53.436552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.437935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.438453 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.439678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:53.444249 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:53.492941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 899/1820] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:53 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:01:53.498361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:53.511328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a663de-af2a-4dae-b98e-76f41cf62d80 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:53.541992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:53.659221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:53.660636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.661544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.662146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.663973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:53.668390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:53.708372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 922/1821] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:01:53 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:01:53.714066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:53.738381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cced0e-7cff-4330-a2fe-e84c6c87983c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:53.748299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:53.749516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.750121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.750534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.751956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:53.763546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:53.789464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 900/1822] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:53.797137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:53.816878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13369496-1683-461e-b279-e062b7c05830 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:53.831165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c582e6-b0a9-4066-b1bc-12de758db379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:53.832416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c582e6-b0a9-4066-b1bc-12de758db379 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.833020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c582e6-b0a9-4066-b1bc-12de758db379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.833402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c582e6-b0a9-4066-b1bc-12de758db379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.834220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c582e6-b0a9-4066-b1bc-12de758db379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:53.837845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c582e6-b0a9-4066-b1bc-12de758db379 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:53.861169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 923/1823] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:01:53.867255 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:53.898926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85069818-48c2-4062-a2f3-e19bc85d5570 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:53.907946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:53.909162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.909732 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.910800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] PATH_INFO: `/v3/projects/69416126de6b418daba86201e3d2ccd0/users/7c10a8e7bbdb435889bee8d4ec987f6b/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:53.940820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69416126de6b418daba86201e3d2ccd0, user_id=7c10a8e7bbdb435889bee8d4ec987f6b, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:53.947219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:53.972565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 901/1824] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:01:53 2022] PUT /identity/v3/projects/69416126de6b418daba86201e3d2ccd0/users/7c10a8e7bbdb435889bee8d4ec987f6b/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:53.980296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:53.981391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:53.981932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:54.020102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:54.021621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:54.158054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 924/1825] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:01:54.174647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:54.176945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:54.284112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:54.293396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ff1de-b601-4897-b6bc-ab86c114c487 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:54.301921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e258789-fe0a-45d7-b931-8a7c148a9280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:54.302212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e258789-fe0a-45d7-b931-8a7c148a9280 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:54.302671 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e258789-fe0a-45d7-b931-8a7c148a9280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:54.303109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e258789-fe0a-45d7-b931-8a7c148a9280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:54.319380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e258789-fe0a-45d7-b931-8a7c148a9280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:54.321799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e258789-fe0a-45d7-b931-8a7c148a9280 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:54.344461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 902/1826] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:01:56.866813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:56.868997 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:56.889960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00de9b-e1c4-4fbe-8996-c9d3846fe796 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:56.904444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:56.906378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:56.907644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:56.909916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] PATH_INFO: `/v3/users/50ebf7bf3a7d48fbb47a351b1fa435d3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:56.910133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ebf7bf3a7d48fbb47a351b1fa435d3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:56.913741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:57.017480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ebf7bf3a7d48fbb47a351b1fa435d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:57.018291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ebf7bf3a7d48fbb47a351b1fa435d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:57.080213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ebf7bf3a7d48fbb47a351b1fa435d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:57.104345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ebf7bf3a7d48fbb47a351b1fa435d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:57.156271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ebf7bf3a7d48fbb47a351b1fa435d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:57.179364 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 925/1827] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:01:56 2022] DELETE /identity/v3/users/50ebf7bf3a7d48fbb47a351b1fa435d3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:57.184701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:57.187243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:57.189827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:57.281803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:57.284046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:57.446205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 903/1828] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:57.461810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:57.466180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:57.527309 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:57.628564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18f07a-4420-48bb-99fe-4b7502832d67 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:57.636983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb74e1-3c47-457e-a732-137f304aaf16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:57.639955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb74e1-3c47-457e-a732-137f304aaf16 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:57.640964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb74e1-3c47-457e-a732-137f304aaf16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:57.641749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb74e1-3c47-457e-a732-137f304aaf16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:57.665815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb74e1-3c47-457e-a732-137f304aaf16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:57.668979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb74e1-3c47-457e-a732-137f304aaf16 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:57.684238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 926/1829] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:01:59.317559 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:59.320082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:59.337618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac5f48-6219-468d-9055-917b5dd2683d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:59.350730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:59.351855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:59.352465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:59.352960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] PATH_INFO: `/v3/projects/8863b997cf534fc980dff9ca860196b9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:59.357295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8863b997cf534fc980dff9ca860196b9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:59.363921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:59.477423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8863b997cf534fc980dff9ca860196b9', 'request_id': 'req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:59.501245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8863b997cf534fc980dff9ca860196b9', 'request_id': 'req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:59.513118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8863b997cf534fc980dff9ca860196b9', 'request_id': 'req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:59.555424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] The token cache is being invalidate because project 8863b997cf534fc980dff9ca860196b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:01:59.555982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:59.559054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ecb8555f-b3e1-4f7b-9823-c9f43d62cd77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:01:59.561654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 904/1830] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:01:59 2022] DELETE /identity/v3/projects/8863b997cf534fc980dff9ca860196b9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:01:59.568639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc448-e9d4-4356-b3bb-835e80c93ccc None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:59.569559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc448-e9d4-4356-b3bb-835e80c93ccc None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:59.569559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc448-e9d4-4356-b3bb-835e80c93ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:59.597443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-fecfc448-e9d4-4356-b3bb-835e80c93ccc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:59.598910 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-fecfc448-e9d4-4356-b3bb-835e80c93ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:59.781042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 927/1831] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:59.790520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828b4a-de74-424f-9ad2-f4088636d091 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:59.791294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828b4a-de74-424f-9ad2-f4088636d091 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:59.791684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828b4a-de74-424f-9ad2-f4088636d091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:59.814294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5e828b4a-de74-424f-9ad2-f4088636d091 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:01:59.815813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5e828b4a-de74-424f-9ad2-f4088636d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:01:59.829902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 905/1832] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:01:59.831719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfc448-e9d4-4356-b3bb-835e80c93ccc None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:59.857669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfc448-e9d4-4356-b3bb-835e80c93ccc None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:59.868695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:59.870037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:59.871198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:59.871677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:59.876133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:01:59.876804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:59.881141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:01:59.926609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 928/1833] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:01:59.930608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e828b4a-de74-424f-9ad2-f4088636d091 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:01:59.945259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e828b4a-de74-424f-9ad2-f4088636d091 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:01:59.962154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:01:59.963018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:01:59.963295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:01:59.963630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:01:59.964353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:01:59.966628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:00.040770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 906/1834] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:01:59 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:02:00.043070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:00.059025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0c4dc-e2f7-4367-90a3-e89946a5cae8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:00.196342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:00.197604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:00.197604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:00.197604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:00.198242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:00.200516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:00.247667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 929/1835] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:02:00 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:02:00.250526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:00.270391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c9b68-a922-43f5-8ef7-7d8b9aa082ff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:00.276130 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:00.276844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:00.277125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:00.277458 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:00.278132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:00.279903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:00.313376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 907/1836] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:02:00.315470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:00.341952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95da8e-fc83-48b3-8cec-7f19a74b4131 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:00.380237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe43bc7-6b18-45f4-9204-568455ac03bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:00.381389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43bc7-6b18-45f4-9204-568455ac03bd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:00.382629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43bc7-6b18-45f4-9204-568455ac03bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:00.383240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43bc7-6b18-45f4-9204-568455ac03bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:00.384431 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe43bc7-6b18-45f4-9204-568455ac03bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:00.391689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe43bc7-6b18-45f4-9204-568455ac03bd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:00.441044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 930/1837] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:02:00.442461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:00.456808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd182-4d0f-40e4-af1a-933071b7561d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:00.485271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:00.486199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:00.486585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:00.486880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] PATH_INFO: `/v3/projects/314910abe95d46b5b8fe0fc7ca938534/users/8972314bdd914129bc2f4424343da7b4/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:00.567544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314910abe95d46b5b8fe0fc7ca938534, user_id=8972314bdd914129bc2f4424343da7b4, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:00.574742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:00.628034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 908/1838] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:02:00 2022] PUT /identity/v3/projects/314910abe95d46b5b8fe0fc7ca938534/users/8972314bdd914129bc2f4424343da7b4/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:02:00.635913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251fac0-2778-445a-863d-6893898df0d0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:00.636456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251fac0-2778-445a-863d-6893898df0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:00.636925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251fac0-2778-445a-863d-6893898df0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:00.731414 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2251fac0-2778-445a-863d-6893898df0d0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:00.733978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2251fac0-2778-445a-863d-6893898df0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:00.794569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:01.002646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 931/1839] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:01.107595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:01.110317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:01.142066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:01.331895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ba87-f4c4-427d-826d-ac8cf6ffdcb8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:01.345900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:01.347230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:01.350210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:01.350210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:01.380788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:01.385670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:01.415813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 909/1840] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:02:03.563352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defec77-757c-4ae2-ba8d-ef19c6fecdb2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:03.564207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defec77-757c-4ae2-ba8d-ef19c6fecdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:03.564381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defec77-757c-4ae2-ba8d-ef19c6fecdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:03.636909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1defec77-757c-4ae2-ba8d-ef19c6fecdb2 None None] MFA Rules not processed for user `7c10a8e7bbdb435889bee8d4ec987f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:03.639511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1defec77-757c-4ae2-ba8d-ef19c6fecdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:03.786614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 932/1841] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:02:03.790957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:03.793829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:03.818799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93c092-e10a-401e-89f3-80536a6f7ca0 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:03.829974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:03.832133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:03.832803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:03.833474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:03.835186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:03.839458 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:03.891621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 910/1842] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:02:03 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:02:03.893214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defec77-757c-4ae2-ba8d-ef19c6fecdb2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:03.907409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defec77-757c-4ae2-ba8d-ef19c6fecdb2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:04.034422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:04.035637 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:04.035964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:04.036235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:04.037225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:04.040063 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:04.096505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:04.104343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 933/1843] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:02:03 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:02:04.111622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800cef-c294-443d-b76a-c739255df80f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:04.119211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76de7c-1497-4ca5-8d1d-423573ffa989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:04.120325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76de7c-1497-4ca5-8d1d-423573ffa989 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:04.120935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76de7c-1497-4ca5-8d1d-423573ffa989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:04.121412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76de7c-1497-4ca5-8d1d-423573ffa989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:04.122370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76de7c-1497-4ca5-8d1d-423573ffa989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:04.124602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76de7c-1497-4ca5-8d1d-423573ffa989 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:04.141285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 911/1844] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:02:04.145866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:04.158334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792c184-35fd-4d4d-9100-64648f78669b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:04.165405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:04.167107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:04.167107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:04.167107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] PATH_INFO: `/v3/projects/b46a0b2aba534e90b0c741a5d3e47dca/users/b369c1f326b64cb1a8f23fe450724e2c/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:04.187726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46a0b2aba534e90b0c741a5d3e47dca, user_id=b369c1f326b64cb1a8f23fe450724e2c, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:04.190869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:04.221973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 934/1845] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:02:04 2022] PUT /identity/v3/projects/b46a0b2aba534e90b0c741a5d3e47dca/users/b369c1f326b64cb1a8f23fe450724e2c/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:02:04.227738 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:04.228207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:04.228831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:04.229759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:04.307163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:04.352437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] MFA Rules not processed for user `8972314bdd914129bc2f4424343da7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:04.356877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:04.431687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355705e2-61f0-45c0-91ac-053fcee1e592 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:04.438292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:04.439304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:04.439732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:04.440146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:04.441088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:04.443294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:04.485342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 935/1846] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:02:04.489772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:04.513112 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b16de-4f0b-4b2d-a274-10a18978dda7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:04.527113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b605907-90b8-4897-a9ce-9abce053c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:04.527825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605907-90b8-4897-a9ce-9abce053c33e admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:04.528102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605907-90b8-4897-a9ce-9abce053c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:04.528374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605907-90b8-4897-a9ce-9abce053c33e admin admin] PATH_INFO: `/v3/projects/b46a0b2aba534e90b0c741a5d3e47dca/users/b369c1f326b64cb1a8f23fe450724e2c/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:04.530495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b605907-90b8-4897-a9ce-9abce053c33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46a0b2aba534e90b0c741a5d3e47dca, user_id=b369c1f326b64cb1a8f23fe450724e2c, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:04.535737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 912/1847] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:04.539344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b605907-90b8-4897-a9ce-9abce053c33e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:04.553222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:04.556417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:04.587346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 936/1848] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:02:04 2022] PUT /identity/v3/projects/b46a0b2aba534e90b0c741a5d3e47dca/users/b369c1f326b64cb1a8f23fe450724e2c/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:02:04.681001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cca43-44bc-4761-85c6-9f4b507ee352 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:04.722593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:04.822885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7e55e-d42f-4de1-9551-20e767ef8f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:04.823964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e55e-d42f-4de1-9551-20e767ef8f48 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:04.824241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e55e-d42f-4de1-9551-20e767ef8f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:04.825008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e55e-d42f-4de1-9551-20e767ef8f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:04.936339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7e55e-d42f-4de1-9551-20e767ef8f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:04.937960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7e55e-d42f-4de1-9551-20e767ef8f48 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:04.953027 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 913/1849] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:02:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:02:07.013023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8630-10f6-4c1c-899f-06b1c46d555f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:07.013986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8630-10f6-4c1c-899f-06b1c46d555f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:07.014432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd8630-10f6-4c1c-899f-06b1c46d555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:07.060287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-33cd8630-10f6-4c1c-899f-06b1c46d555f None None] MFA Rules not processed for user `8972314bdd914129bc2f4424343da7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:07.077796 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-33cd8630-10f6-4c1c-899f-06b1c46d555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:07.115749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 937/1850] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:02:10.374754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:10.375261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:10.375361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:10.408685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] MFA Rules not processed for user `62e872a76ae44efb845dc3a62b783492`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:10.410652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:10.598593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 914/1851] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:17.047987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:17.519873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:17.520152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:17.520434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:17.561302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] MFA Rules not processed for user `b369c1f326b64cb1a8f23fe450724e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:17.563080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:17.686979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 938/1852] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:17.918995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:17.920493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:18.077124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60632149-45ab-454b-9006-ea5f04259d15 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:18.084474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:18.085405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:18.086009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:18.086629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:18.121392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:18.185815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:18.189168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:18.202520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 915/1853] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:02:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:02:19.093884 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:19.095565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:19.324039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795aac1b-903b-44fa-b8b7-bdb3c83c5652 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:19.340706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:19.341682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:19.342128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:19.342599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] PATH_INFO: `/v3/users/b9db2dcc6e7b413d93595a74f8f59b4f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:19.345148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9db2dcc6e7b413d93595a74f8f59b4f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:19.348569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:19.455472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9db2dcc6e7b413d93595a74f8f59b4f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:19.456662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9db2dcc6e7b413d93595a74f8f59b4f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:19.468776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9db2dcc6e7b413d93595a74f8f59b4f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:19.483303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9db2dcc6e7b413d93595a74f8f59b4f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:19.507471 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9db2dcc6e7b413d93595a74f8f59b4f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:19.520006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 939/1854] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:02:19 2022] DELETE /identity/v3/users/b9db2dcc6e7b413d93595a74f8f59b4f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:02:19.839455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:19.917563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216312-4b0d-4ab5-af40-de02d23648eb service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:20.098054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:20.098881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:20.099260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:20.099625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] PATH_INFO: `/v3/projects/09d60fd1f22e4cf5961d85f43f87d7ce` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:20.102519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d60fd1f22e4cf5961d85f43f87d7ce)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:20.104908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:20.213575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d60fd1f22e4cf5961d85f43f87d7ce', 'request_id': 'req-c9ff0396-b502-4278-8ad6-20ee80cf1373'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.234264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d60fd1f22e4cf5961d85f43f87d7ce', 'request_id': 'req-c9ff0396-b502-4278-8ad6-20ee80cf1373'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.247690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d60fd1f22e4cf5961d85f43f87d7ce', 'request_id': 'req-c9ff0396-b502-4278-8ad6-20ee80cf1373'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.283998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] The token cache is being invalidate because project 09d60fd1f22e4cf5961d85f43f87d7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:02:20.284287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.284964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.286584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 916/1855] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:02:19 2022] DELETE /identity/v3/projects/09d60fd1f22e4cf5961d85f43f87d7ce => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:02:20.291264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:20.293167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:20.308002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:20.325091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eedc96-a249-4a4b-ad3a-1c42f583c92c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:20.445737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:20.447780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:20.448273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:20.448924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] PATH_INFO: `/v3/users/d0414f75c5f345729a7ffb782e894bd3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:20.451397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0414f75c5f345729a7ffb782e894bd3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:20.455293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:20.581384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0414f75c5f345729a7ffb782e894bd3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.582935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0414f75c5f345729a7ffb782e894bd3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.601419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0414f75c5f345729a7ffb782e894bd3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.614273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0414f75c5f345729a7ffb782e894bd3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.654159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c897645a-9f7f-4c69-a3ab-f34b5c44bbf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0414f75c5f345729a7ffb782e894bd3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:20.670157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 940/1856] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:02:20 2022] DELETE /identity/v3/users/d0414f75c5f345729a7ffb782e894bd3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:02:21.231767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:21.240294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:21.264141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff0396-b502-4278-8ad6-20ee80cf1373 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:21.389953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:21.415111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:21.415766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:21.416043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:21.416311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] PATH_INFO: `/v3/projects/6844715c948b433097efdf19ee550681` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:21.417630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6844715c948b433097efdf19ee550681)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:21.419704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:21.492013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6844715c948b433097efdf19ee550681', 'request_id': 'req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:21.502181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6844715c948b433097efdf19ee550681', 'request_id': 'req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:21.516730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6844715c948b433097efdf19ee550681', 'request_id': 'req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:21.572545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] The token cache is being invalidate because project 6844715c948b433097efdf19ee550681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:02:21.573048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:21.576628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-22a69b7d-69b7-4dcf-b94f-93ecd4e43e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:02:21.598704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 917/1857] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:02:21 2022] DELETE /identity/v3/projects/6844715c948b433097efdf19ee550681 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:02:21.996301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94953-58a8-4248-a8bd-6f5c743704dd None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:21.997137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94953-58a8-4248-a8bd-6f5c743704dd None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:21.997137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c94953-58a8-4248-a8bd-6f5c743704dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:22.021802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-80c94953-58a8-4248-a8bd-6f5c743704dd None None] MFA Rules not processed for user `7c10a8e7bbdb435889bee8d4ec987f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:22.023499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-80c94953-58a8-4248-a8bd-6f5c743704dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:22.107541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 941/1858] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:24.530809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:24.531690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:24.532168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:24.553226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] MFA Rules not processed for user `e416a0a02d8e460494d6545c35096d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:24.554693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:24.617082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 918/1859] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:27.704093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fb79a-317c-49ff-a463-d18c32ef9d5f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:27.708256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fb79a-317c-49ff-a463-d18c32ef9d5f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:27.708505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fb79a-317c-49ff-a463-d18c32ef9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:27.736291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ed3fb79a-317c-49ff-a463-d18c32ef9d5f None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:27.738998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ed3fb79a-317c-49ff-a463-d18c32ef9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:27.815591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:27.878152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 942/1860] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:02:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:27.938246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:27.940233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:28.046886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b076c-bd71-4f63-871b-ac11b2567eeb None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:28.052575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c21a58-3eaa-420a-a276-584f46d8d29c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:28.053233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21a58-3eaa-420a-a276-584f46d8d29c service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:28.053510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21a58-3eaa-420a-a276-584f46d8d29c service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:28.053779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c21a58-3eaa-420a-a276-584f46d8d29c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:28.063589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c21a58-3eaa-420a-a276-584f46d8d29c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:28.065482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c21a58-3eaa-420a-a276-584f46d8d29c service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:28.078336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 919/1861] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:02:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:02:37.863189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=12 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:38.074093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:38.338594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574431cb-461e-4877-b928-ac4705ea1f17 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:38.338943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574431cb-461e-4877-b928-ac4705ea1f17 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:38.339424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574431cb-461e-4877-b928-ac4705ea1f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:38.393498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-574431cb-461e-4877-b928-ac4705ea1f17 None None] MFA Rules not processed for user `6c5db537b1ad455395e4c9a931036c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:38.400506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-574431cb-461e-4877-b928-ac4705ea1f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:38.521312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 943/1862] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:02:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:48.507027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=25 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:52.742022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b540ba-e1ea-4bd5-b396-36f37cabf381 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:52.743526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b540ba-e1ea-4bd5-b396-36f37cabf381 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:52.743965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b540ba-e1ea-4bd5-b396-36f37cabf381 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:52.746916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 920/1863] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:02:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:02:52.755179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edfbb2-bb90-430c-b828-8b9540feb1d3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:52.756535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edfbb2-bb90-430c-b828-8b9540feb1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:52.757198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edfbb2-bb90-430c-b828-8b9540feb1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:52.795757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f0edfbb2-bb90-430c-b828-8b9540feb1d3 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:52.797623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f0edfbb2-bb90-430c-b828-8b9540feb1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:52.962949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 944/1864] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:02:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:52.983435 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b540ba-e1ea-4bd5-b396-36f37cabf381 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:52.985558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-44b540ba-e1ea-4bd5-b396-36f37cabf381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:53.099307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b540ba-e1ea-4bd5-b396-36f37cabf381 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:53.103022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaf3b0-02f6-489c-88cf-cbdb6cad07ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78db6f3cf17421898e1597c65998fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:53.103634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaf3b0-02f6-489c-88cf-cbdb6cad07ab service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:53.103943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaf3b0-02f6-489c-88cf-cbdb6cad07ab service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:53.104211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaf3b0-02f6-489c-88cf-cbdb6cad07ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:53.115618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaf3b0-02f6-489c-88cf-cbdb6cad07ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:53.117071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaf3b0-02f6-489c-88cf-cbdb6cad07ab service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:53.128986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 921/1865] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:02:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:02:53.214720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23aa4a-6279-4dd6-8e64-dd6929670a8f None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:53.215148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23aa4a-6279-4dd6-8e64-dd6929670a8f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:53.215599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23aa4a-6279-4dd6-8e64-dd6929670a8f None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:53.217790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 945/1866] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:02:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:02:53.223725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981f3e-ee90-42cb-98af-485a0d372fe9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:53.224057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981f3e-ee90-42cb-98af-485a0d372fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:53.224386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42981f3e-ee90-42cb-98af-485a0d372fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:53.248146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-42981f3e-ee90-42cb-98af-485a0d372fe9 None None] MFA Rules not processed for user `985db5d7ded74dbeaa8fae4515fea049`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:53.249586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-42981f3e-ee90-42cb-98af-485a0d372fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:53.316515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 922/1867] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:53.331211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23aa4a-6279-4dd6-8e64-dd6929670a8f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:53.334033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2c23aa4a-6279-4dd6-8e64-dd6929670a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:53.355599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23aa4a-6279-4dd6-8e64-dd6929670a8f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:53.361463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2591c91-6acc-49c5-9f2d-7102931fb5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:53.362585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2591c91-6acc-49c5-9f2d-7102931fb5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:53.363123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2591c91-6acc-49c5-9f2d-7102931fb5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:53.363645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2591c91-6acc-49c5-9f2d-7102931fb5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:53.376794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2591c91-6acc-49c5-9f2d-7102931fb5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:53.379451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2591c91-6acc-49c5-9f2d-7102931fb5ca service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:53.392754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 946/1868] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:02:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:02:53.497177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7115-903a-4a68-9e88-7b1a31042a6f None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:53.497485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7115-903a-4a68-9e88-7b1a31042a6f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:53.497703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7115-903a-4a68-9e88-7b1a31042a6f None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:53.499164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 923/1869] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:02:53.506839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa3d0-1e7f-4bae-a382-db4e06033785 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:53.507124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa3d0-1e7f-4bae-a382-db4e06033785 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:53.507423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afa3d0-1e7f-4bae-a382-db4e06033785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:53.530107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-91afa3d0-1e7f-4bae-a382-db4e06033785 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:53.532643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-91afa3d0-1e7f-4bae-a382-db4e06033785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:53.541959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 947/1870] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:02:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:53.557285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f7115-903a-4a68-9e88-7b1a31042a6f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:53.572578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f7115-903a-4a68-9e88-7b1a31042a6f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:53.578851 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:53.580111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:53.580586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:53.581048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:53.597313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:53.598908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:53.613945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 924/1871] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:02:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:02:57.145651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dd41f-f27a-47fc-97ca-e1b0b4fdc948 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:57.146451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dd41f-f27a-47fc-97ca-e1b0b4fdc948 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:57.146451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dd41f-f27a-47fc-97ca-e1b0b4fdc948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:57.169040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-2f5dd41f-f27a-47fc-97ca-e1b0b4fdc948 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:57.170382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2f5dd41f-f27a-47fc-97ca-e1b0b4fdc948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:57.271385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 948/1872] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:57.351274 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:57.352860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:57.368401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075356-61b1-4352-a664-ae2d0c3e80fc service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:57.374920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:57.375579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:57.375863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:57.376133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:57.386201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:57.387912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:57.399932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 925/1873] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:02:58.097213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d643-5422-4686-805e-6763f6b8d5c2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:58.097495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d643-5422-4686-805e-6763f6b8d5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:58.097943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909d643-5422-4686-805e-6763f6b8d5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:58.120209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c909d643-5422-4686-805e-6763f6b8d5c2 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:02:58.121721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c909d643-5422-4686-805e-6763f6b8d5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:02:58.130687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 949/1874] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:02:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:02:58.148572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:02:58.165332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26c1f-8b29-47be-84c2-3e30d012417a service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:02:58.171735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:02:58.172814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:02:58.173322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:02:58.173767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:02:58.184416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:02:58.187075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:02:58.210525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 926/1875] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:02:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:03:00.409907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:00.411085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:00.411702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:00.438976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:00.440680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:00.443713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:00.445614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:00.461167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 950/1876] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:00.483634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:00.486014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:00.509316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb3c50-3939-46b5-bf23-6c42215f1a2b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:00.516471 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:00.517582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:00.518022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:00.518446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:00.533768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:00.536823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:00.569095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 951/1877] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:00.573623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:00.620363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069ac5-126d-4035-9dcf-32f81f963740 service swift] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:00.633549 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f78bf6-f9f6-4897-98d3-b5bb09ab5c15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:00.635599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78bf6-f9f6-4897-98d3-b5bb09ab5c15 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:00.636145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78bf6-f9f6-4897-98d3-b5bb09ab5c15 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:00.637000 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f78bf6-f9f6-4897-98d3-b5bb09ab5c15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:00.643399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-85f78bf6-f9f6-4897-98d3-b5bb09ab5c15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:00.674418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f78bf6-f9f6-4897-98d3-b5bb09ab5c15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:00.680150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f78bf6-f9f6-4897-98d3-b5bb09ab5c15 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:00.719755 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 927/1878] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:04.192533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:04.194016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:04.213700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebfc24-8f55-4fc1-8478-fa2bfe875f7a service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:04.217714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c9a6a-03f0-4b66-8f22-1c8861c63ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:04.218667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c9a6a-03f0-4b66-8f22-1c8861c63ccd service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:04.219101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c9a6a-03f0-4b66-8f22-1c8861c63ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:04.219519 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c9a6a-03f0-4b66-8f22-1c8861c63ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:04.221622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f70c9a6a-03f0-4b66-8f22-1c8861c63ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:04.289461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:04.324177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c9a6a-03f0-4b66-8f22-1c8861c63ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:04.325529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c9a6a-03f0-4b66-8f22-1c8861c63ccd service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:04.348499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 952/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:05.957911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f7ee-2ad1-4b82-a18a-309e293766a0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:05.958859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f7ee-2ad1-4b82-a18a-309e293766a0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:05.958859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f7ee-2ad1-4b82-a18a-309e293766a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:05.967036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0df9-8d95-411d-836c-6f1bc645d27b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:05.968859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0df9-8d95-411d-836c-6f1bc645d27b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:05.969588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0df9-8d95-411d-836c-6f1bc645d27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:06.027775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2269f7ee-2ad1-4b82-a18a-309e293766a0 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:06.030482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2269f7ee-2ad1-4b82-a18a-309e293766a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:06.070690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 928/1880] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:06.092619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269f7ee-2ad1-4b82-a18a-309e293766a0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:06.120709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9c1a0df9-8d95-411d-836c-6f1bc645d27b None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:06.126760 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9c1a0df9-8d95-411d-836c-6f1bc645d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:06.138848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269f7ee-2ad1-4b82-a18a-309e293766a0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:06.162419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739a7e4-3524-4921-bcd9-99d6edbb3d44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:06.164483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739a7e4-3524-4921-bcd9-99d6edbb3d44 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:06.165373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739a7e4-3524-4921-bcd9-99d6edbb3d44 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:06.167285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739a7e4-3524-4921-bcd9-99d6edbb3d44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:06.178836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 953/1881] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:03:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:06.192306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a0df9-8d95-411d-836c-6f1bc645d27b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:06.216924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739a7e4-3524-4921-bcd9-99d6edbb3d44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:06.220791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739a7e4-3524-4921-bcd9-99d6edbb3d44 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:06.243474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a0df9-8d95-411d-836c-6f1bc645d27b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:06.268651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:06.269951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:06.270879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:06.271791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 929/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:03:06.272635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:06.294036 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:06.297182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:06.317979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 954/1883] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:03:16.244551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=17 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:16.310108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=18 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:18.931798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e210c-29a7-46f7-9e2e-a36d745f4a8e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:18.933224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e210c-29a7-46f7-9e2e-a36d745f4a8e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:18.933224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e210c-29a7-46f7-9e2e-a36d745f4a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:18.963789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-323e210c-29a7-46f7-9e2e-a36d745f4a8e None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:18.965102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-323e210c-29a7-46f7-9e2e-a36d745f4a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:18.974209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 930/1884] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 11 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:03:18.992536 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:19.009040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309423e-b9c3-4ea2-b9c0-ba8c5f6597b6 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:19.015575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229f8f4-e0af-4856-9e85-2fe362c55e60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:19.016279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229f8f4-e0af-4856-9e85-2fe362c55e60 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:19.016613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229f8f4-e0af-4856-9e85-2fe362c55e60 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:19.016954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229f8f4-e0af-4856-9e85-2fe362c55e60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:19.027428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229f8f4-e0af-4856-9e85-2fe362c55e60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:19.029079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229f8f4-e0af-4856-9e85-2fe362c55e60 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:19.039714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 955/1885] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:03:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:03:21.578511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb58809-d22c-41b7-9816-69ba08a7bf71 None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:21.579107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb58809-d22c-41b7-9816-69ba08a7bf71 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:21.579107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb58809-d22c-41b7-9816-69ba08a7bf71 None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:21.580506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 931/1886] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:03:21.591222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:21.591839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:21.591839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:21.613287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] MFA Rules not processed for user `bba839bb4641430cb81a78a8d8242a11`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:21.614564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:21.624820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 956/1887] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:03:21.643713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb58809-d22c-41b7-9816-69ba08a7bf71 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:21.663419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb58809-d22c-41b7-9816-69ba08a7bf71 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:21.669824 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:21.670603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:21.671101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:21.671376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:21.679464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:21.681088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:21.686330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:21.688203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:21.702380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b08b-e2e8-4e5d-802e-64b09188d82c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:21.708887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:21.709586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:21.709926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 932/1888] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:21.719506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:21.719790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] PATH_INFO: `/v3/users/e416a0a02d8e460494d6545c35096d7e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:21.721412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e416a0a02d8e460494d6545c35096d7e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:21.723722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:21.794223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e416a0a02d8e460494d6545c35096d7e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:21.795000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e416a0a02d8e460494d6545c35096d7e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:21.803242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e416a0a02d8e460494d6545c35096d7e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:21.812245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e416a0a02d8e460494d6545c35096d7e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:21.829028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7caf5c6d-de2e-4891-83d4-d51e82470ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e416a0a02d8e460494d6545c35096d7e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:21.838643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 957/1889] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:03:21 2022] DELETE /identity/v3/users/e416a0a02d8e460494d6545c35096d7e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:03:22.070391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:22.083661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336a7d2-e0e4-4241-9af6-a4248b5b5a20 service placement] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:22.160985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:22.161664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.161941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.162211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] PATH_INFO: `/v3/projects/83cfd51cb48f4af4896a5e4a61389e6d` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.163764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cfd51cb48f4af4896a5e4a61389e6d)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:22.165779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:22.218706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cfd51cb48f4af4896a5e4a61389e6d', 'request_id': 'req-4d5e190f-ee06-414f-9f2f-f9cab62e0336'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:22.225799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cfd51cb48f4af4896a5e4a61389e6d', 'request_id': 'req-4d5e190f-ee06-414f-9f2f-f9cab62e0336'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:22.234066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cfd51cb48f4af4896a5e4a61389e6d', 'request_id': 'req-4d5e190f-ee06-414f-9f2f-f9cab62e0336'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:22.246903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] The token cache is being invalidate because project 83cfd51cb48f4af4896a5e4a61389e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:03:22.247199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:22.247762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4d5e190f-ee06-414f-9f2f-f9cab62e0336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:22.249390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 933/1890] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:03:22 2022] DELETE /identity/v3/projects/83cfd51cb48f4af4896a5e4a61389e6d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:03:22.255627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c391ef3-a7bc-4f3d-9f99-9b2af2fefcff None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.255917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c391ef3-a7bc-4f3d-9f99-9b2af2fefcff None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.256184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c391ef3-a7bc-4f3d-9f99-9b2af2fefcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.279984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0c391ef3-a7bc-4f3d-9f99-9b2af2fefcff None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:22.281237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0c391ef3-a7bc-4f3d-9f99-9b2af2fefcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:22.351785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 958/1891] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:22.363336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedc5b2-d814-48e9-831a-e2f13d9a5231 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.363828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedc5b2-d814-48e9-831a-e2f13d9a5231 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.363991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedc5b2-d814-48e9-831a-e2f13d9a5231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.396200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-acedc5b2-d814-48e9-831a-e2f13d9a5231 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:22.397902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-acedc5b2-d814-48e9-831a-e2f13d9a5231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:22.411305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 934/1892] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:22.418275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c391ef3-a7bc-4f3d-9f99-9b2af2fefcff None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:22.434076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c391ef3-a7bc-4f3d-9f99-9b2af2fefcff None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:22.439704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:22.440359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.440642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.440918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.441612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:03:22.441916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:22.444724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:22.459402 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 959/1893] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:03:22.462754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedc5b2-d814-48e9-831a-e2f13d9a5231 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:22.474257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedc5b2-d814-48e9-831a-e2f13d9a5231 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:22.484039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:22.484705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.484983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.485250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.486148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:22.488268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:22.523900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 935/1894] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:03:22 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:03:22.529233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:22.544398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc70053-3a86-427d-aaad-41e7177c7b42 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:22.623685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:22.648991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:22.649658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.649971 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.650231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.650955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:22.652950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:22.690811 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 960/1895] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:03:22 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:03:22.693781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:22.710010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb07114-f328-40b8-ae8f-61de1172f32b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:22.717982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:22.718904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.719545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.720155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.721891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:22.725386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:22.748733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 936/1896] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:03:22.754581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:22.777654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfc588-5dce-43d6-b4cb-2f0bb17fa5fd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:22.786739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ac9e9-1e04-47cf-98c6-525fe3b4dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:22.787682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac9e9-1e04-47cf-98c6-525fe3b4dd82 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.788683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac9e9-1e04-47cf-98c6-525fe3b4dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.789163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ac9e9-1e04-47cf-98c6-525fe3b4dd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.790317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac9e9-1e04-47cf-98c6-525fe3b4dd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:22.792947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ac9e9-1e04-47cf-98c6-525fe3b4dd82 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:22.816371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 961/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:03:22.824373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:22.864357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ed068-65be-4777-acce-4732daebbca8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:22.875565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f52bf-ecab-44b2-a031-015e22f63aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:22.877752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f52bf-ecab-44b2-a031-015e22f63aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.878853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f52bf-ecab-44b2-a031-015e22f63aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.879349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f52bf-ecab-44b2-a031-015e22f63aa1 admin admin] PATH_INFO: `/v3/projects/412178783923491990f3ea47825c86c8/users/373ed0db3e294b3c8e0bd1d354a8b532/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.917766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f52bf-ecab-44b2-a031-015e22f63aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412178783923491990f3ea47825c86c8, user_id=373ed0db3e294b3c8e0bd1d354a8b532, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:22.920757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f52bf-ecab-44b2-a031-015e22f63aa1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:22.937952 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 937/1898] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:03:22 2022] PUT /identity/v3/projects/412178783923491990f3ea47825c86c8/users/373ed0db3e294b3c8e0bd1d354a8b532/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:03:22.956507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:22.957042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:22.957516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:22.995304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] MFA Rules not processed for user `373ed0db3e294b3c8e0bd1d354a8b532`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:22.996818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:23.003512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:23.004116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:23.005340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:23.022336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:23.033506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:23.036268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:23.082746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 962/1899] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:23.097675 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:23.099588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:23.128268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 938/1900] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:03:23.151505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:23.153743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:23.191704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13310c-ccdf-45eb-8495-643415ae1797 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:23.198807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737559-4d80-4be4-8581-6d84adb39d49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78db6f3cf17421898e1597c65998fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:23.200157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737559-4d80-4be4-8581-6d84adb39d49 service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:23.200969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737559-4d80-4be4-8581-6d84adb39d49 service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:23.201355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737559-4d80-4be4-8581-6d84adb39d49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:23.214753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737559-4d80-4be4-8581-6d84adb39d49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:23.217635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737559-4d80-4be4-8581-6d84adb39d49 service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:23.237132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 963/1901] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:23.291010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877488f-8a34-4d8f-80ed-b8e72565e4d3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:23.300800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:23.301096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:23.302002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:23.302449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:23.317256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:23.318963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:23.335019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 939/1902] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:03:27.299956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09cc4-43c5-4021-947a-9955217df636 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:27.300814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09cc4-43c5-4021-947a-9955217df636 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:27.300814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09cc4-43c5-4021-947a-9955217df636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:27.327327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-19f09cc4-43c5-4021-947a-9955217df636 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:27.328625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-19f09cc4-43c5-4021-947a-9955217df636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:27.338034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 964/1903] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:27.362352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:27.363975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:27.381339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3d7d-473b-4980-909a-72068c8e4578 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:27.388470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:27.389106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:27.389324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:27.389579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:27.399953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:27.401721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:27.414214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 940/1904] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:03:28.666351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec23c97-4db5-4977-b3fb-5d63986f9e23 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:28.666936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec23c97-4db5-4977-b3fb-5d63986f9e23 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:28.666936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec23c97-4db5-4977-b3fb-5d63986f9e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:28.690715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3ec23c97-4db5-4977-b3fb-5d63986f9e23 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:28.692335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3ec23c97-4db5-4977-b3fb-5d63986f9e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:28.749795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:28.773179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 965/1905] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 11 12:03:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:28.801603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:28.803810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:28.918769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58f739-6b65-449d-8c7f-0c58b19aac15 service nova] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:28.925474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:28.926173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:28.926369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:28.926675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:28.936588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:28.938239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:28.949331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 941/1906] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:03:32.547780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3a24-7763-4459-afb4-7256106c0ec3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:32.548274 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3a24-7763-4459-afb4-7256106c0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:32.548388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3a24-7763-4459-afb4-7256106c0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:32.569619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3bcc3a24-7763-4459-afb4-7256106c0ec3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:32.570881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3bcc3a24-7763-4459-afb4-7256106c0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:32.580183 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 966/1907] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:32.597190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:32.612670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4c0c6-bff6-4965-9fd0-0bd56ac44596 service swift] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:32.621606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7625d0-e877-4e65-8ac5-9efb200f345b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:32.622135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7625d0-e877-4e65-8ac5-9efb200f345b service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:32.622413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7625d0-e877-4e65-8ac5-9efb200f345b service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:32.622713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7625d0-e877-4e65-8ac5-9efb200f345b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:32.629596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:32.632548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7625d0-e877-4e65-8ac5-9efb200f345b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:32.634868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7625d0-e877-4e65-8ac5-9efb200f345b service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:32.646922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 942/1908] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:42.563422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=8 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:42.641896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:52.068245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3a24-7763-4459-afb4-7256106c0ec3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:52.078582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3a24-7763-4459-afb4-7256106c0ec3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:52.083908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:52.084556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:52.084834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:52.085100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] PATH_INFO: `/v3/users/373ed0db3e294b3c8e0bd1d354a8b532` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:52.086292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373ed0db3e294b3c8e0bd1d354a8b532)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:52.088286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:52.139073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373ed0db3e294b3c8e0bd1d354a8b532'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.139786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373ed0db3e294b3c8e0bd1d354a8b532'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.150628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373ed0db3e294b3c8e0bd1d354a8b532'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.160644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373ed0db3e294b3c8e0bd1d354a8b532'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.174725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373ed0db3e294b3c8e0bd1d354a8b532'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.181512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 967/1909] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:03:52 2022] DELETE /identity/v3/users/373ed0db3e294b3c8e0bd1d354a8b532 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:03:52.186422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe55e7-a136-4e26-90d6-c02e9d4bc36e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:52.186993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe55e7-a136-4e26-90d6-c02e9d4bc36e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:52.186993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe55e7-a136-4e26-90d6-c02e9d4bc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:52.207343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fbfe55e7-a136-4e26-90d6-c02e9d4bc36e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:52.208592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fbfe55e7-a136-4e26-90d6-c02e9d4bc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:52.274096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 943/1910] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:52.284864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:52.286573 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:52.347719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2c69-0a7e-4da6-8368-8b0e1891b8b3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:52.351516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:52.352124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:52.352394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:52.352654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:52.362664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:52.364081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:52.378483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 968/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:52.707696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e9dd-485f-4c6b-97f3-5697f980f31f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:52.707968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e9dd-485f-4c6b-97f3-5697f980f31f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:52.708345 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9e9dd-485f-4c6b-97f3-5697f980f31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:52.719975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:52.723993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:52.747142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547752b0-162d-4e0c-99e9-991c3515af27 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:52.749443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-01f9e9dd-485f-4c6b-97f3-5697f980f31f None None] MFA Rules not processed for user `8972314bdd914129bc2f4424343da7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:52.751901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-01f9e9dd-485f-4c6b-97f3-5697f980f31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:52.757483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:52.758130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:52.758409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:52.759618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] PATH_INFO: `/v3/projects/412178783923491990f3ea47825c86c8` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:52.761112 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=412178783923491990f3ea47825c86c8)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:52.763139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:52.825296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412178783923491990f3ea47825c86c8', 'request_id': 'req-24c74a79-c0d1-4d97-b020-cfd71795e98f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.830904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 944/1912] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:52.843446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412178783923491990f3ea47825c86c8', 'request_id': 'req-24c74a79-c0d1-4d97-b020-cfd71795e98f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.855187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412178783923491990f3ea47825c86c8', 'request_id': 'req-24c74a79-c0d1-4d97-b020-cfd71795e98f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.864461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:52.871142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] The token cache is being invalidate because project 412178783923491990f3ea47825c86c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:03:52.871824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.873638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-24c74a79-c0d1-4d97-b020-cfd71795e98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:03:52.876060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 969/1913] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:03:52 2022] DELETE /identity/v3/projects/412178783923491990f3ea47825c86c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:03:52.880744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e396-0e92-4eb9-b1a0-ce9ef887c1dd None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:52.881047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e396-0e92-4eb9-b1a0-ce9ef887c1dd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:52.881283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e396-0e92-4eb9-b1a0-ce9ef887c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:52.909721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9ab2e396-0e92-4eb9-b1a0-ce9ef887c1dd None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:52.910208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9ab2e396-0e92-4eb9-b1a0-ce9ef887c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:52.976981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 945/1914] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:52.985356 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333583-981d-4a5d-b63d-d663beb6ab76 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:52.985634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333583-981d-4a5d-b63d-d663beb6ab76 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:52.985904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333583-981d-4a5d-b63d-d663beb6ab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.007522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-82333583-981d-4a5d-b63d-d663beb6ab76 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:53.008867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-82333583-981d-4a5d-b63d-d663beb6ab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:53.017636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 970/1915] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:53.022013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e396-0e92-4eb9-b1a0-ce9ef887c1dd None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:53.031756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e396-0e92-4eb9-b1a0-ce9ef887c1dd None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:53.037441 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:53.038504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.038879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.039150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.039816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:03:53.040114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:53.041706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:53.053996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 946/1916] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:03:53.058416 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82333583-981d-4a5d-b63d-d663beb6ab76 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:53.068007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82333583-981d-4a5d-b63d-d663beb6ab76 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:53.072746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:53.073354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.073628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.073895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.074542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:53.076461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:53.105272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 971/1917] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:03:53 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:03:53.109463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:53.120041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725647d-bdd4-4511-b3cf-9e0b4ffe5375 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:53.151009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:53.180103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:53.180716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.180978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.181257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.181925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:53.183909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:53.205619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 947/1918] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:03:53 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:03:53.209780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:53.220692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a82123-da8c-4226-a26b-1821093bbc88 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:53.225459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:53.226125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.226405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.226712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.227354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:53.228954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:53.240160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 972/1919] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:03:53.244367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:53.254574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e5516-3f73-4f31-88cf-0f79683906bb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:53.259174 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7bb4a-1ef8-4cd3-bffd-835240ba0eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:53.259788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7bb4a-1ef8-4cd3-bffd-835240ba0eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.260062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7bb4a-1ef8-4cd3-bffd-835240ba0eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.260348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7bb4a-1ef8-4cd3-bffd-835240ba0eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.260976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7bb4a-1ef8-4cd3-bffd-835240ba0eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:53.262606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7bb4a-1ef8-4cd3-bffd-835240ba0eeb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:53.277422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 948/1920] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:03:53.279194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:53.289628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcd854-a48a-4a8c-8ee9-93d4413a197a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:53.294384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:53.295078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.295355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.295621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] PATH_INFO: `/v3/projects/69bf9a733e9c44d5b2f5209cf56698ac/users/64646ccce829408bbfaa787cd3bf89fa/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.312822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bf9a733e9c44d5b2f5209cf56698ac, user_id=64646ccce829408bbfaa787cd3bf89fa, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:53.315533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:53.330287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 973/1921] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:03:53 2022] PUT /identity/v3/projects/69bf9a733e9c44d5b2f5209cf56698ac/users/64646ccce829408bbfaa787cd3bf89fa/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:03:53.342111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42a25-1d5a-47ae-a68c-8336bf9e466d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.342396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42a25-1d5a-47ae-a68c-8336bf9e466d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.342701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42a25-1d5a-47ae-a68c-8336bf9e466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.386779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b4b42a25-1d5a-47ae-a68c-8336bf9e466d None None] MFA Rules not processed for user `64646ccce829408bbfaa787cd3bf89fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:53.388573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b4b42a25-1d5a-47ae-a68c-8336bf9e466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:53.472047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 949/1922] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:03:53.488733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:03:53.490516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:53.560647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8978b-a302-4c10-b87b-83e24ce33a74 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:03:53.564863 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bdcab-61ec-49a7-a984-166d2cab6247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:03:53.565483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bdcab-61ec-49a7-a984-166d2cab6247 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:53.565761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bdcab-61ec-49a7-a984-166d2cab6247 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:53.566029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bdcab-61ec-49a7-a984-166d2cab6247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:53.574392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bdcab-61ec-49a7-a984-166d2cab6247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:03:53.576207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bdcab-61ec-49a7-a984-166d2cab6247 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:03:53.586015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 974/1923] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:03:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:03:55.026443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb468-ffe1-4348-9801-c31c903cf1fd None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:03:55.027019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb468-ffe1-4348-9801-c31c903cf1fd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:03:55.027019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb468-ffe1-4348-9801-c31c903cf1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:03:55.050935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-dc8fb468-ffe1-4348-9801-c31c903cf1fd None None] MFA Rules not processed for user `64646ccce829408bbfaa787cd3bf89fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:03:55.052128 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dc8fb468-ffe1-4348-9801-c31c903cf1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:03:55.064197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 950/1924] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:03:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:02.842882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:02.843442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:02.843442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:02.869673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] MFA Rules not processed for user `62e872a76ae44efb845dc3a62b783492`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:02.871006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:02.942110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 975/1925] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:04:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:05.045576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:10.093170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3683a4c-4343-41ae-9d42-a3c5e91ef85f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:10.093935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3683a4c-4343-41ae-9d42-a3c5e91ef85f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:10.093935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3683a4c-4343-41ae-9d42-a3c5e91ef85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:10.115162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d3683a4c-4343-41ae-9d42-a3c5e91ef85f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:10.117530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d3683a4c-4343-41ae-9d42-a3c5e91ef85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:10.180739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 951/1926] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:10.195926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:10.197504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:10.251061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:10.285048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff3e52-3525-4ca1-88f5-786900bdec03 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:10.291563 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:10.292179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:10.292485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:10.292782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:10.302028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:10.303772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:10.313922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 976/1927] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:04:16.515060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0606c-5909-4727-bde4-46a92d30b2fd None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:16.516221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0606c-5909-4727-bde4-46a92d30b2fd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:16.516221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0606c-5909-4727-bde4-46a92d30b2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:16.545415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-51a0606c-5909-4727-bde4-46a92d30b2fd None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:16.547328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-51a0606c-5909-4727-bde4-46a92d30b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:16.557585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 952/1928] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:16.575219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:16.587756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03868e9-d3aa-4279-887b-6882ea6b25ba service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:16.594123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:16.594778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:16.595057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:16.595457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:16.604270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:16.606000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:16.619577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 977/1929] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:04:20.637419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc0506-8a4a-4cd3-8fc8-62549f3bbab1 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:20.638136 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc0506-8a4a-4cd3-8fc8-62549f3bbab1 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:20.638136 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc0506-8a4a-4cd3-8fc8-62549f3bbab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:20.675789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-17dc0506-8a4a-4cd3-8fc8-62549f3bbab1 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:20.677172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17dc0506-8a4a-4cd3-8fc8-62549f3bbab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:20.693650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 953/1930] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:20.708256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:20.709954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:20.725685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f312b-1a87-4d0e-b246-eff33e0693ee service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:20.732485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:20.733137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:20.733412 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:20.733676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:20.745861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:20.747619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:20.760749 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 978/1931] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:04:20.822040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78818680-945c-41f9-b749-bb25021fd406 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:20.823268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78818680-945c-41f9-b749-bb25021fd406 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:20.824094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78818680-945c-41f9-b749-bb25021fd406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:20.859331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-78818680-945c-41f9-b749-bb25021fd406 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:20.861384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-78818680-945c-41f9-b749-bb25021fd406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:20.930499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 954/1932] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:20.943347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:20.944980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:21.024009 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546b518-828f-45c0-8fdd-762384b39eef service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:21.029222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:21.029843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:21.030120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:21.030389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:21.039978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:21.041594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:21.051925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 979/1933] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:04:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:04:21.588078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171da37f-9031-4fc3-b519-f7b27bd9963d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:21.588376 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171da37f-9031-4fc3-b519-f7b27bd9963d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:21.588651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171da37f-9031-4fc3-b519-f7b27bd9963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:21.610149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-171da37f-9031-4fc3-b519-f7b27bd9963d None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:21.611386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-171da37f-9031-4fc3-b519-f7b27bd9963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:21.619888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 955/1934] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 11 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:21.634037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:21.645166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4364c33-ea26-4948-bac9-c61674fed6ec service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:21.651130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:21.651769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:21.652012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:21.652279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:21.661918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:21.663942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:21.672271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 980/1935] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:04:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:04:21.920471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42e60-08bf-43ac-b08f-7d9095398035 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:21.921036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42e60-08bf-43ac-b08f-7d9095398035 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:21.921036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac42e60-08bf-43ac-b08f-7d9095398035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:21.945877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-6ac42e60-08bf-43ac-b08f-7d9095398035 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:21.947430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6ac42e60-08bf-43ac-b08f-7d9095398035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:21.964124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 956/1936] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:21.977672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:21.989933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6cff3-8d71-4891-8d43-ff3f0a320c0b service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:21.995607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:21.996325 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:21.996661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:21.996977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:22.014255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:22.016540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:22.030051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 981/1937] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:04:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:04:22.399814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215b56b-aac5-4453-87d2-aae26a6e0103 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:22.400104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215b56b-aac5-4453-87d2-aae26a6e0103 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:22.400361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215b56b-aac5-4453-87d2-aae26a6e0103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:22.421090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4215b56b-aac5-4453-87d2-aae26a6e0103 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:22.422459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4215b56b-aac5-4453-87d2-aae26a6e0103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:22.431049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 957/1938] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 11 12:04:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:22.448157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:22.460930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e5af6-8dd9-46f6-9ddb-9d7a35af3b24 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:22.467626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:22.468245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:22.468522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:22.468787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:22.478457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:22.480095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:22.488990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 982/1939] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:04:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:04:23.847897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363a260-0d34-4ea2-9bd6-598f438016fa None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:23.848676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363a260-0d34-4ea2-9bd6-598f438016fa None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:23.848676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363a260-0d34-4ea2-9bd6-598f438016fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:23.871583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1363a260-0d34-4ea2-9bd6-598f438016fa None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:23.873135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1363a260-0d34-4ea2-9bd6-598f438016fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:23.883815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 958/1940] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:23.902226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:23.916800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5228-3e0e-4b83-be13-2e234f630163 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:23.923231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b64489-8ddf-407e-a8c3-47f510785d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:23.923961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b64489-8ddf-407e-a8c3-47f510785d45 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:23.924335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b64489-8ddf-407e-a8c3-47f510785d45 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:23.924745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b64489-8ddf-407e-a8c3-47f510785d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:23.934597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b64489-8ddf-407e-a8c3-47f510785d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:23.936302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b64489-8ddf-407e-a8c3-47f510785d45 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:23.947274 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 983/1941] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:04:24.719320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363a260-0d34-4ea2-9bd6-598f438016fa None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:24.730440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363a260-0d34-4ea2-9bd6-598f438016fa None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:24.737302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:24.737977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:24.738252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:24.738514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] PATH_INFO: `/v3/users/64646ccce829408bbfaa787cd3bf89fa` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:24.739889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=64646ccce829408bbfaa787cd3bf89fa)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:24.741930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:24.799729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64646ccce829408bbfaa787cd3bf89fa'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:24.800386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64646ccce829408bbfaa787cd3bf89fa'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:24.811497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:24.816668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64646ccce829408bbfaa787cd3bf89fa'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:24.827765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64646ccce829408bbfaa787cd3bf89fa'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:24.828733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64646ccce829408bbfaa787cd3bf89fa'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:24.850213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 959/1942] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:04:24 2022] DELETE /identity/v3/users/64646ccce829408bbfaa787cd3bf89fa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:04:24.856661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775c85-0064-4248-9168-286434165325 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:24.857613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775c85-0064-4248-9168-286434165325 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:24.858097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37775c85-0064-4248-9168-286434165325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:24.884107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-37775c85-0064-4248-9168-286434165325 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:24.885357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-37775c85-0064-4248-9168-286434165325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:24.935251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:24.981827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 984/1943] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:04:24.991634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:24.993224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:25.062985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149c25-9746-4b94-b654-2807b758ce9c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:25.067881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7171583-5637-407b-b0e0-e05a4784586e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:25.068614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7171583-5637-407b-b0e0-e05a4784586e service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:25.068977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7171583-5637-407b-b0e0-e05a4784586e service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:25.069333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7171583-5637-407b-b0e0-e05a4784586e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:25.080211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7171583-5637-407b-b0e0-e05a4784586e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:25.081650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7171583-5637-407b-b0e0-e05a4784586e service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:25.092852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 960/1944] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:04:25.280406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775c85-0064-4248-9168-286434165325 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:25.284005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-37775c85-0064-4248-9168-286434165325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:25.298456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37775c85-0064-4248-9168-286434165325 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:25.304212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:25.304871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:25.305148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:25.305418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] PATH_INFO: `/v3/projects/69bf9a733e9c44d5b2f5209cf56698ac` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:25.306722 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bf9a733e9c44d5b2f5209cf56698ac)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:25.308672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:25.368268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bf9a733e9c44d5b2f5209cf56698ac', 'request_id': 'req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:25.377330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bf9a733e9c44d5b2f5209cf56698ac', 'request_id': 'req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:25.387782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bf9a733e9c44d5b2f5209cf56698ac', 'request_id': 'req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:25.400955 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] The token cache is being invalidate because project 69bf9a733e9c44d5b2f5209cf56698ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:04:25.401293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:25.401980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:04:25.403605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 985/1945] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:04:25 2022] DELETE /identity/v3/projects/69bf9a733e9c44d5b2f5209cf56698ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:04:29.097350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7eb31-7e80-4d53-ac22-efe8b218428d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:29.097791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7eb31-7e80-4d53-ac22-efe8b218428d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:29.097880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7eb31-7e80-4d53-ac22-efe8b218428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:29.133788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-37e7eb31-7e80-4d53-ac22-efe8b218428d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:29.135321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-37e7eb31-7e80-4d53-ac22-efe8b218428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:29.211653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 961/1946] 10.222.0.46 () {58 vars in 1016 bytes} [Tue Oct 11 12:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:29.241012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:04:29.242811 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:29.334406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763ba28-bbc2-4068-8905-cbc3cd2a30d6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:04:29.342135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877227ac-abe5-4547-a5f4-716eb53c5c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:04:29.342799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877227ac-abe5-4547-a5f4-716eb53c5c9d service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:29.343070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877227ac-abe5-4547-a5f4-716eb53c5c9d service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:29.343337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877227ac-abe5-4547-a5f4-716eb53c5c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:29.353326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877227ac-abe5-4547-a5f4-716eb53c5c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:04:29.355223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877227ac-abe5-4547-a5f4-716eb53c5c9d service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:04:29.365945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 986/1947] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:04:30.646445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f266-6cdb-4fbf-acaa-4a81f7af0256 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:30.646987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f266-6cdb-4fbf-acaa-4a81f7af0256 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:30.647103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f266-6cdb-4fbf-acaa-4a81f7af0256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:30.667359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2c16f266-6cdb-4fbf-acaa-4a81f7af0256 None None] MFA Rules not processed for user `89f04c92184043c3a6cd7249340519dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:30.668568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2c16f266-6cdb-4fbf-acaa-4a81f7af0256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:30.737877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 962/1948] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:04:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:39.361463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:40.730250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=2,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:42.466489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:42.467059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:42.467059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:42.488787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] MFA Rules not processed for user `6c5db537b1ad455395e4c9a931036c65`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:42.490011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:42.550102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 987/1949] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:04:52.542434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=25 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:55.097522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:04:55.098299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:04:55.098299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:04:55.120283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] MFA Rules not processed for user `c3dd26a68dd14618bd8d26f5acc7ed0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:04:55.121520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:04:55.195206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 963/1950] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:04:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:01.772680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:01.774121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:01.806922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:01.808605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:01.826720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed10e7-5de8-40de-a3a6-2399ac31bbf6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:01.832586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:01.833299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:01.833645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:01.833920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] PATH_INFO: `/v3/users/8972314bdd914129bc2f4424343da7b4` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:01.835092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8972314bdd914129bc2f4424343da7b4)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:01.837119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:01.845678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671748d5-aaf5-4889-9647-e2686e800297 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:01.849259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:01.849869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:01.850139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:01.850403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:01.852559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:01.867338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:01.869691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:01.881957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 988/1951] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:01.887682 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8972314bdd914129bc2f4424343da7b4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:01.888309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8972314bdd914129bc2f4424343da7b4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:01.901673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8972314bdd914129bc2f4424343da7b4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:01.909227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8972314bdd914129bc2f4424343da7b4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:01.909977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4741b152-18ec-4029-9111-ad6459a8cfba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8972314bdd914129bc2f4424343da7b4'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:01.935392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 964/1952] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:05:01 2022] DELETE /identity/v3/users/8972314bdd914129bc2f4424343da7b4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:05:02.129977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.141565 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf677de4-30e1-4aeb-8b72-1abef4521bf9 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:02.209240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:02.209893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.210169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.210440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] PATH_INFO: `/v3/projects/314910abe95d46b5b8fe0fc7ca938534` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.211635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=314910abe95d46b5b8fe0fc7ca938534)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:02.213721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:02.266729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314910abe95d46b5b8fe0fc7ca938534', 'request_id': 'req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:02.273076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314910abe95d46b5b8fe0fc7ca938534', 'request_id': 'req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:02.282467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314910abe95d46b5b8fe0fc7ca938534', 'request_id': 'req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:02.295285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] The token cache is being invalidate because project 314910abe95d46b5b8fe0fc7ca938534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:05:02.295285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:02.295746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8cf8b7ef-d6c9-4426-97c8-169b418dd0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:02.297456 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 989/1953] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:05:02 2022] DELETE /identity/v3/projects/314910abe95d46b5b8fe0fc7ca938534 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:02.303201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9eb84-194c-4956-90ea-9c8ad07fb105 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.303514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9eb84-194c-4956-90ea-9c8ad07fb105 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.303801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9eb84-194c-4956-90ea-9c8ad07fb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.331613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c3e9eb84-194c-4956-90ea-9c8ad07fb105 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:02.332842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c3e9eb84-194c-4956-90ea-9c8ad07fb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:02.398301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 965/1954] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:02.406951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf4288-fecd-4b52-ad79-9e378ea16854 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.407337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf4288-fecd-4b52-ad79-9e378ea16854 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.407677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf4288-fecd-4b52-ad79-9e378ea16854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.430633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-bcdf4288-fecd-4b52-ad79-9e378ea16854 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:02.431948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bcdf4288-fecd-4b52-ad79-9e378ea16854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:02.440916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 990/1955] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:05:02.446715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9eb84-194c-4956-90ea-9c8ad07fb105 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.458107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9eb84-194c-4956-90ea-9c8ad07fb105 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:02.464203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:02.465127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.465421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.465872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.466568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:05:02.466879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:02.468577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:02.485967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 966/1956] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:05:02.487252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf4288-fecd-4b52-ad79-9e378ea16854 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.496937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf4288-fecd-4b52-ad79-9e378ea16854 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:02.502131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:02.502852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.503140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.503442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.504081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:02.506161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:02.552612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.554601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 991/1957] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:05:02 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:02.568006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:02.575976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1ca3c-4e35-49ea-8ea2-a848faeaffa1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:02.671884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:02.672600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.672975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.673275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.674019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:02.676277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:02.702955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 967/1958] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:05:02 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:02.708940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.717996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:02.724996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a1510-0703-455d-b67c-ab3e221f88e3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:02.732801 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:02.733945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.734368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.734742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.735674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:02.737671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:02.752250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 992/1959] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:05:02.756918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.769585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b648c-d27a-49c2-9ed3-8ceddbe63544 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:02.774950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16593f77-903e-4cc2-a298-cb6aaa149fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:02.775571 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593f77-903e-4cc2-a298-cb6aaa149fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.775842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593f77-903e-4cc2-a298-cb6aaa149fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.776115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16593f77-903e-4cc2-a298-cb6aaa149fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.776744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16593f77-903e-4cc2-a298-cb6aaa149fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:02.778545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16593f77-903e-4cc2-a298-cb6aaa149fc5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:02.791347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 968/1960] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:05:02.796357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.807512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159913f3-6ad4-4fc2-87a9-b33d7a2dbfc9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:02.813636 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:02.814318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.814662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.814933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] PATH_INFO: `/v3/projects/0689099f561949dea35ae7141a338f3c/users/948868c97aa74a71bd2f2485d0877893/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.831200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0689099f561949dea35ae7141a338f3c, user_id=948868c97aa74a71bd2f2485d0877893, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:02.833944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:02.851132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 993/1961] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:05:02 2022] PUT /identity/v3/projects/0689099f561949dea35ae7141a338f3c/users/948868c97aa74a71bd2f2485d0877893/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:02.861516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:02.862325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:02.862325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:02.895316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] MFA Rules not processed for user `948868c97aa74a71bd2f2485d0877893`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:02.896801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:02.972251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 969/1962] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:05:02.984913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:02.986872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:03.063785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d11a9-0a87-4b1c-a944-489254de9bbe admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:03.067662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:03.068300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:03.068578 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:03.068849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:03.078385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:03.079919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:03.090056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 994/1963] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:04.302584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:04.311111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:04.383480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c73483-924a-4922-80d6-1b53a5d81792 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:04.390076 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196abed-2496-4444-83b4-8d58abc8647c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:04.390925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196abed-2496-4444-83b4-8d58abc8647c service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:04.391218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196abed-2496-4444-83b4-8d58abc8647c service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:04.391544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196abed-2496-4444-83b4-8d58abc8647c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:04.394666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f196abed-2496-4444-83b4-8d58abc8647c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:04.425341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:04.474763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196abed-2496-4444-83b4-8d58abc8647c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:04.476205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196abed-2496-4444-83b4-8d58abc8647c service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:04.487510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 970/1964] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:08.229881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:08.296073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6d7ec-845a-46de-9db9-7d04531f7dc8 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:08.301538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:08.302171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:08.302441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:08.302742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] PATH_INFO: `/v3/users/948868c97aa74a71bd2f2485d0877893` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:08.303959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948868c97aa74a71bd2f2485d0877893)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:08.305931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:08.368757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948868c97aa74a71bd2f2485d0877893'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:08.369466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948868c97aa74a71bd2f2485d0877893'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:08.378343 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948868c97aa74a71bd2f2485d0877893'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:08.389310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948868c97aa74a71bd2f2485d0877893'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:08.397995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:08.405539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948868c97aa74a71bd2f2485d0877893'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:08.413219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 995/1965] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:05:08 2022] DELETE /identity/v3/users/948868c97aa74a71bd2f2485d0877893 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:08.417850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:08.418516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:08.418516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:08.440412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:08.441608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:08.514478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 971/1966] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:08.525773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:08.528205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:08.590685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ba75c-e6b2-4c2c-8223-6c4c4cfadae3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:08.594534 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:08.595168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:08.595442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:08.595709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:08.605076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:08.606507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:08.616064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 996/1967] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:08.912750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:08.914434 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:08.931083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c8251-1965-423e-bb3b-ca2deaf4fa8c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:08.939548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:08.940361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:08.940704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:08.940982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] PATH_INFO: `/v3/projects/0689099f561949dea35ae7141a338f3c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:08.942638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0689099f561949dea35ae7141a338f3c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:08.944861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:09.000148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0689099f561949dea35ae7141a338f3c', 'request_id': 'req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:09.006404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0689099f561949dea35ae7141a338f3c', 'request_id': 'req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:09.015798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0689099f561949dea35ae7141a338f3c', 'request_id': 'req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:09.027330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] The token cache is being invalidate because project 0689099f561949dea35ae7141a338f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:05:09.027598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:09.028232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbccbfdc-0a31-406b-8b7d-a91fbd17eaff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:09.029731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 972/1968] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:05:08 2022] DELETE /identity/v3/projects/0689099f561949dea35ae7141a338f3c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:14.073294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:14.074790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:14.167072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33234f49-7287-4988-9713-59f9e7f59774 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:14.243319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:14.243936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:14.244210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:14.244454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:14.246594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:14.279434 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:14.314876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:14.316526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:14.326927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 997/1969] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:16.558087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:16.558649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:16.558649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:16.578643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] MFA Rules not processed for user `62e872a76ae44efb845dc3a62b783492`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:16.579865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:16.586980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 973/1970] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:24.322008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=14 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:26.573377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:31.791912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:31.793236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:31.808049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc862e4-1f7d-48d7-a96e-0ed0b1c27cf4 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:31.814544 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b4f99-94de-4d22-a345-1713b58f66a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:31.815287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b4f99-94de-4d22-a345-1713b58f66a4 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:31.815555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b4f99-94de-4d22-a345-1713b58f66a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:31.815821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b4f99-94de-4d22-a345-1713b58f66a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:31.817842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5e0b4f99-94de-4d22-a345-1713b58f66a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:31.882994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b4f99-94de-4d22-a345-1713b58f66a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:31.884583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b4f99-94de-4d22-a345-1713b58f66a4 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:31.894829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 998/1971] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:36.248927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:36.250674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:36.270783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aefdd-2ef1-4b3c-9697-02f705f23a6b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:36.277751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e3a96-a83f-453b-814c-7bd681e6d922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:36.278384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3a96-a83f-453b-814c-7bd681e6d922 service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:36.278690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3a96-a83f-453b-814c-7bd681e6d922 service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:36.278961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e3a96-a83f-453b-814c-7bd681e6d922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:36.281090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f67e3a96-a83f-453b-814c-7bd681e6d922 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:36.359954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e3a96-a83f-453b-814c-7bd681e6d922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:36.361625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e3a96-a83f-453b-814c-7bd681e6d922 service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:36.373056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 974/1972] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:41.889885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=28 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:42.979516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498673-9c90-4a31-a66c-4a034fbf3191 None None] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:42.980789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498673-9c90-4a31-a66c-4a034fbf3191 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:42.981152 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498673-9c90-4a31-a66c-4a034fbf3191 None None] PATH_INFO: `/` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:42.983446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 999/1973] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:05:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:05:42.992905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1c84-29b6-44b9-a8f3-eb122df1365f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:42.993456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1c84-29b6-44b9-a8f3-eb122df1365f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:42.993456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a1c84-29b6-44b9-a8f3-eb122df1365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:43.017227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a17a1c84-29b6-44b9-a8f3-eb122df1365f None None] MFA Rules not processed for user `985db5d7ded74dbeaa8fae4515fea049`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:43.018722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a17a1c84-29b6-44b9-a8f3-eb122df1365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:43.087992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 975/1974] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:05:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:43.103452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498673-9c90-4a31-a66c-4a034fbf3191 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:43.105788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-01498673-9c90-4a31-a66c-4a034fbf3191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:43.123577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01498673-9c90-4a31-a66c-4a034fbf3191 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:43.127333 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a55883-29a9-4a2a-97cd-7bd92214c98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:43.127953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55883-29a9-4a2a-97cd-7bd92214c98a service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:43.128227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55883-29a9-4a2a-97cd-7bd92214c98a service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:43.128571 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55883-29a9-4a2a-97cd-7bd92214c98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:43.136628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a55883-29a9-4a2a-97cd-7bd92214c98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:43.138067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a55883-29a9-4a2a-97cd-7bd92214c98a service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:43.147321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1000/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:43.239443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb739-cf68-4ef7-a08b-8478d9a9665c None None] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:43.239861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb739-cf68-4ef7-a08b-8478d9a9665c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:43.240198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb739-cf68-4ef7-a08b-8478d9a9665c None None] PATH_INFO: `/` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:43.241719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 976/1976] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 11 12:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 11 12:05:43.248418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:43.248715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:43.248981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:43.270342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] MFA Rules not processed for user `c3fb3dc7226c48f1a33c6e73d3ff32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:43.271633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:43.281337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1001/1977] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 11 12:05:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:43.292992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfb739-cf68-4ef7-a08b-8478d9a9665c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:43.294834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-34dfb739-cf68-4ef7-a08b-8478d9a9665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:43.309868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfb739-cf68-4ef7-a08b-8478d9a9665c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:43.313790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:43.314415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:43.314810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:43.314991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:43.327571 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:43.329110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:43.341026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 977/1978] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:43.411163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:43.413429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:43.496488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268e5c-8db1-49f3-95e8-ab0eef140454 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:43.502350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:43.503048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:43.503319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:43.503603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:43.505399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:43.521780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:43.523473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:43.534353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1002/1979] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:48.442959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:48.452329 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ebc9e-88c3-4beb-b942-ffbe15a16951 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:48.457973 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:48.458612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:48.458969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:48.459256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:48.461734 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:48.475436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:48.477313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:48.486173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 978/1980] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:49.664445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:49.678123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ce714-7c17-4838-bb1b-d116b2007f08 service placement] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:49.685262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:49.685881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:49.686155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:49.686421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:49.688329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:49.724786 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:49.734243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dd992-0e74-474a-9e9d-fbe917a0cf1f service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:49.738967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:49.739772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:49.739999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:49.740306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:49.743661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:49.759375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:49.761226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:49.776107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1003/1981] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:49.826737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:49.828391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:49.839879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 979/1982] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:53.879642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:53.881229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:53.897431 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72348d-7888-4ae2-8b04-d38759f958c1 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:53.902024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:53.902747 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:53.903022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:53.903284 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] PATH_INFO: `/v3/users/6c5db537b1ad455395e4c9a931036c65` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:53.904389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5db537b1ad455395e4c9a931036c65)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:53.906384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:53.960435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5db537b1ad455395e4c9a931036c65'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:53.961118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5db537b1ad455395e4c9a931036c65'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:53.968269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5db537b1ad455395e4c9a931036c65'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:53.977200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5db537b1ad455395e4c9a931036c65'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:53.981134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:53.993274 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0a794269-6dd7-4826-b73b-4c30500cc290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5db537b1ad455395e4c9a931036c65'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:53.999422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1004/1983] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:05:53 2022] DELETE /identity/v3/users/6c5db537b1ad455395e4c9a931036c65 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:54.278484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:54.291887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9c547-6b2f-4b96-a00f-fe58fc087a6d service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:54.305009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:54.349236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:54.349873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.350143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.350405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] PATH_INFO: `/v3/projects/0193d6c100f44567935ba9af77212fb1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.351546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=0193d6c100f44567935ba9af77212fb1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:54.353469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:54.403774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0193d6c100f44567935ba9af77212fb1', 'request_id': 'req-ac9a7689-988c-46d3-8a0f-74bd88454ded'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:54.409591 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0193d6c100f44567935ba9af77212fb1', 'request_id': 'req-ac9a7689-988c-46d3-8a0f-74bd88454ded'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:54.418168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0193d6c100f44567935ba9af77212fb1', 'request_id': 'req-ac9a7689-988c-46d3-8a0f-74bd88454ded'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:54.429574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] The token cache is being invalidate because project 0193d6c100f44567935ba9af77212fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:05:54.429874 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:54.430491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ac9a7689-988c-46d3-8a0f-74bd88454ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:54.432022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 980/1984] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:05:54 2022] DELETE /identity/v3/projects/0193d6c100f44567935ba9af77212fb1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:54.437176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09ca5-d509-4622-a24a-3a71066a1f88 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.437522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09ca5-d509-4622-a24a-3a71066a1f88 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.437794 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea09ca5-d509-4622-a24a-3a71066a1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.458703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-aea09ca5-d509-4622-a24a-3a71066a1f88 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:54.460010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-aea09ca5-d509-4622-a24a-3a71066a1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:54.534121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1005/1985] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:54.542714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01cae-b1af-4141-8747-da3281024fbc None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.542992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01cae-b1af-4141-8747-da3281024fbc None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.543267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01cae-b1af-4141-8747-da3281024fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.564540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-62a01cae-b1af-4141-8747-da3281024fbc None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:54.565736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-62a01cae-b1af-4141-8747-da3281024fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:54.575049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 981/1986] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:54.579500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea09ca5-d509-4622-a24a-3a71066a1f88 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:54.592526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea09ca5-d509-4622-a24a-3a71066a1f88 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:54.598541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:54.599612 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.599892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.600161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.600832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:05:54.601134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:54.603457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:54.622875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1006/1987] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:05:54.624173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a01cae-b1af-4141-8747-da3281024fbc None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:54.635009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a01cae-b1af-4141-8747-da3281024fbc None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:54.640661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:54.641398 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.641849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.642250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.643233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:54.645666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:54.703063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 982/1988] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:05:54 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:54.707775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:54.720312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6fd06-21f2-495b-b47f-8c618c70b722 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:54.794462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fce17-b794-413b-9723-aaac63e66dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:54.795569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fce17-b794-413b-9723-aaac63e66dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.795569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fce17-b794-413b-9723-aaac63e66dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.795810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fce17-b794-413b-9723-aaac63e66dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.796335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fce17-b794-413b-9723-aaac63e66dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:54.798475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fce17-b794-413b-9723-aaac63e66dfc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:54.827015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1007/1989] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:05:54 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:05:54.830065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:54.839712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143bc75-825e-499a-ad70-738b5de9dfd9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.840075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143bc75-825e-499a-ad70-738b5de9dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.840298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143bc75-825e-499a-ad70-738b5de9dfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.843543 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154e803-ef02-44f0-b804-ee18cc524f25 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:54.848704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:54.850794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.851227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.851519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.852191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:54.853916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:54.863281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7143bc75-825e-499a-ad70-738b5de9dfd9 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:54.864660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7143bc75-825e-499a-ad70-738b5de9dfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:54.867196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 983/1990] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:05:54.872190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:54.883462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830575e-71fa-4062-b4f9-3d30962fcd31 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:54.889625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:54.890606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.890956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.891306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.892418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:54.894185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:54.911436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 984/1991] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:05:54.913378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:54.926690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceab0a-1beb-48d2-8866-3a2b9e186e2d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:54.931515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:54.932904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.933186 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.933451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] PATH_INFO: `/v3/projects/4aab198e1dcf49ca840b7bc03ea052a3/users/5daff999476d48efb04c28893953305e/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.935077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1008/1992] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:54.955034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aab198e1dcf49ca840b7bc03ea052a3, user_id=5daff999476d48efb04c28893953305e, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:54.958823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:54.993570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 985/1993] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:05:54 2022] PUT /identity/v3/projects/4aab198e1dcf49ca840b7bc03ea052a3/users/5daff999476d48efb04c28893953305e/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:05:54.997485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96f17-ea21-47cd-8449-50ca1a2fa6e3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:54.998137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96f17-ea21-47cd-8449-50ca1a2fa6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:54.998689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96f17-ea21-47cd-8449-50ca1a2fa6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:54.999835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:55.002102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:55.008069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:55.040088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c8d96f17-ea21-47cd-8449-50ca1a2fa6e3 None None] MFA Rules not processed for user `5daff999476d48efb04c28893953305e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:55.041784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c8d96f17-ea21-47cd-8449-50ca1a2fa6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:55.059427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:55.108689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633f97-ba1b-4d76-8c6e-b50913cf3b4e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:55.115516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:55.118022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.118022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.118022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.146605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1009/1994] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:55.151489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d96f17-ea21-47cd-8449-50ca1a2fa6e3 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:55.230655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:55.232252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:55.244280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 986/1995] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:05:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 11 12:05:55.268391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d96f17-ea21-47cd-8449-50ca1a2fa6e3 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:55.280160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:55.280974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.281394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.281688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.282598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:55.285266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:55.319763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1010/1996] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:05:55 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:55.323568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:55.343690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea4b10-c44f-4118-9b9d-75b46231d5b2 service swift] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:55.485055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:55.485742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.485998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.486265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.486945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:55.489066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:55.538463 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 987/1997] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:05:55 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:55.542611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:55.555992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d2ec-8798-42f1-a432-ecf54616e81d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:55.562289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:55.563092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.564510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.564888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.566026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:55.567935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:55.582728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1011/1998] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:05:55.586431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:55.601985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c01ebc-f5ec-496f-9fab-b493b1d81342 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:55.613451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:55.614402 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.614866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.615387 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] PATH_INFO: `/v3/projects/160b335b932d4cc7b0542b4a18987015/users/9d792c393e2f475088272315f96da2e7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.639490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160b335b932d4cc7b0542b4a18987015, user_id=9d792c393e2f475088272315f96da2e7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:55.642801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:55.706246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 988/1999] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:05:55 2022] PUT /identity/v3/projects/160b335b932d4cc7b0542b4a18987015/users/9d792c393e2f475088272315f96da2e7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:55.706776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:55.715437 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b890e1-8a3e-489e-bda0-fba472cbed8c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:55.848474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197087a7-ce2b-4e6d-b354-7ac6f930f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:55.849202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197087a7-ce2b-4e6d-b354-7ac6f930f535 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.849551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197087a7-ce2b-4e6d-b354-7ac6f930f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.849906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197087a7-ce2b-4e6d-b354-7ac6f930f535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.851120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197087a7-ce2b-4e6d-b354-7ac6f930f535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:55.854269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197087a7-ce2b-4e6d-b354-7ac6f930f535 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:55.870169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1012/2000] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:05:55.874691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:55.903151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a3d21-a216-4856-89c2-38760abc0631 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:55.913563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:55.915888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.915888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.916144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] PATH_INFO: `/v3/projects/160b335b932d4cc7b0542b4a18987015/users/9d792c393e2f475088272315f96da2e7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.919004 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] RBAC: Authorizing `identity:create_grant(project_id=160b335b932d4cc7b0542b4a18987015, user_id=9d792c393e2f475088272315f96da2e7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:55.937647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:55.960660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 989/2001] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:05:55 2022] PUT /identity/v3/projects/160b335b932d4cc7b0542b4a18987015/users/9d792c393e2f475088272315f96da2e7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:55.971264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3098-db9f-49db-8e21-6dfd7a57da86 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:55.971902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3098-db9f-49db-8e21-6dfd7a57da86 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:55.971902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a3098-db9f-49db-8e21-6dfd7a57da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:55.990655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:56.024054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3a2a3098-db9f-49db-8e21-6dfd7a57da86 None None] MFA Rules not processed for user `9d792c393e2f475088272315f96da2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:56.025323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3a2a3098-db9f-49db-8e21-6dfd7a57da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:56.112850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1013/2002] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:05:56.126349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:56.128144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:56.173416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:56.224649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f76fc-eb9e-4619-851f-d634b283711a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:56.230588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ab5bc-5240-462f-8823-222681ab1dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:56.231240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ab5bc-5240-462f-8823-222681ab1dea service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:56.231512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ab5bc-5240-462f-8823-222681ab1dea service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:56.232143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ab5bc-5240-462f-8823-222681ab1dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:56.244297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ab5bc-5240-462f-8823-222681ab1dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:56.247089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ab5bc-5240-462f-8823-222681ab1dea service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:56.261327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 990/2003] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:56.304580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a3098-db9f-49db-8e21-6dfd7a57da86 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:56.406924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a3098-db9f-49db-8e21-6dfd7a57da86 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:56.413265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:56.413926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:56.414195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:56.414459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] PATH_INFO: `/v3/users/5daff999476d48efb04c28893953305e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:56.415651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daff999476d48efb04c28893953305e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:56.417818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:56.499897 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daff999476d48efb04c28893953305e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:56.501410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daff999476d48efb04c28893953305e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:56.510926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daff999476d48efb04c28893953305e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:56.520438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daff999476d48efb04c28893953305e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:56.539920 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daff999476d48efb04c28893953305e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:56.547793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1014/2004] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:05:56 2022] DELETE /identity/v3/users/5daff999476d48efb04c28893953305e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:56.554178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:56.554770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:56.554859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:56.576204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:56.577870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:56.681451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 991/2005] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:56.693237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:56.698442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:56.718904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:56.804454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71829dc-f693-4c99-950e-9efe65a6cbee admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:56.812606 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:56.813483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:56.814039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:56.814595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:56.826623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:56.829001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:56.850260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1015/2006] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:05:57.442742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:57.445819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:57.495750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac16d2-5b01-47d1-bc9a-f53587809602 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:57.504507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:57.505396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:57.505790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:57.506163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] PATH_INFO: `/v3/projects/4aab198e1dcf49ca840b7bc03ea052a3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:57.508461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aab198e1dcf49ca840b7bc03ea052a3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:57.511251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:57.572124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aab198e1dcf49ca840b7bc03ea052a3', 'request_id': 'req-46fc2cc6-5483-47c1-89d4-842f089f5a41'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.580411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aab198e1dcf49ca840b7bc03ea052a3', 'request_id': 'req-46fc2cc6-5483-47c1-89d4-842f089f5a41'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.592184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aab198e1dcf49ca840b7bc03ea052a3', 'request_id': 'req-46fc2cc6-5483-47c1-89d4-842f089f5a41'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.607610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] The token cache is being invalidate because project 4aab198e1dcf49ca840b7bc03ea052a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:05:57.608220 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.609113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.610963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 992/2007] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:05:57 2022] DELETE /identity/v3/projects/4aab198e1dcf49ca840b7bc03ea052a3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:57.617077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:57.630264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924b632-f616-47d0-9d90-ada8ad105a92 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:57.745945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:57.746917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:57.747298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:57.747605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] PATH_INFO: `/v3/users/9d792c393e2f475088272315f96da2e7` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:57.748941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d792c393e2f475088272315f96da2e7)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:57.751124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:57.827540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d792c393e2f475088272315f96da2e7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.828128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d792c393e2f475088272315f96da2e7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.849927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d792c393e2f475088272315f96da2e7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.862365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d792c393e2f475088272315f96da2e7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.881778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7865bbd3-3daf-4459-8c57-6972245367c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d792c393e2f475088272315f96da2e7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:57.891556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1016/2008] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:05:57 2022] DELETE /identity/v3/users/9d792c393e2f475088272315f96da2e7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:58.435192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:58.436693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:58.455534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc2cc6-5483-47c1-89d4-842f089f5a41 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:58.560032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:58.579531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:58.580315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:58.583998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:58.587036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] PATH_INFO: `/v3/projects/160b335b932d4cc7b0542b4a18987015` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:58.591686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=160b335b932d4cc7b0542b4a18987015)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:58.593792 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:58.681512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160b335b932d4cc7b0542b4a18987015', 'request_id': 'req-f4b794eb-941d-451b-b522-731ac550f55b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:58.689078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160b335b932d4cc7b0542b4a18987015', 'request_id': 'req-f4b794eb-941d-451b-b522-731ac550f55b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:58.700691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160b335b932d4cc7b0542b4a18987015', 'request_id': 'req-f4b794eb-941d-451b-b522-731ac550f55b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:58.715980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] The token cache is being invalidate because project 160b335b932d4cc7b0542b4a18987015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:05:58.716371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:58.717110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f4b794eb-941d-451b-b522-731ac550f55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:05:58.723029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 993/2009] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:05:58 2022] DELETE /identity/v3/projects/160b335b932d4cc7b0542b4a18987015 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:58.724894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66fad-b3d4-4fe2-bfc2-e3ee7ab7467e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:58.725999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66fad-b3d4-4fe2-bfc2-e3ee7ab7467e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:58.726336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66fad-b3d4-4fe2-bfc2-e3ee7ab7467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:58.754409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-02f66fad-b3d4-4fe2-bfc2-e3ee7ab7467e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:58.755946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-02f66fad-b3d4-4fe2-bfc2-e3ee7ab7467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:58.789293 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:58.843087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1017/2010] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:58.855720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238cd1-8744-4329-8b86-880df4d6b6a8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:58.856202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238cd1-8744-4329-8b86-880df4d6b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:58.856677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238cd1-8744-4329-8b86-880df4d6b6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:58.886485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e9238cd1-8744-4329-8b86-880df4d6b6a8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:58.887801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e9238cd1-8744-4329-8b86-880df4d6b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:58.896568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 994/2011] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:58.901489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66fad-b3d4-4fe2-bfc2-e3ee7ab7467e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:58.915768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66fad-b3d4-4fe2-bfc2-e3ee7ab7467e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:58.922395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:58.923500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:58.924161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:58.924704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:58.925484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:05:58.925933 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:58.928136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:58.973330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1018/2012] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:05:58.991392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9238cd1-8744-4329-8b86-880df4d6b6a8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.006028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9238cd1-8744-4329-8b86-880df4d6b6a8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.011314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.011951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.012228 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.012492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.013151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.015133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.053563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 995/2013] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:05:58 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:59.057915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.069425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d042be-9a84-4d0f-9643-65f611947e07 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.141548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.142221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.142517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.142836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.143526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.145710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.171703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1019/2014] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:05:59 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:05:59.177893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.188977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb747a5-5d7c-4362-9bd1-fad2c1f85a36 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.195219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.195926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.196221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.196490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.197163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.199114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.217224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 996/2015] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:05:59.218726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.235920 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d08d-6cab-4d2f-aa5d-1ddff42371cf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.242963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26a25-eced-40f3-af2d-16bb498eab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.243692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26a25-eced-40f3-af2d-16bb498eab95 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.244093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26a25-eced-40f3-af2d-16bb498eab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.244279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26a25-eced-40f3-af2d-16bb498eab95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.244950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26a25-eced-40f3-af2d-16bb498eab95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.246859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26a25-eced-40f3-af2d-16bb498eab95 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.268061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1020/2016] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:05:59.269701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.285823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243927c9-b0bd-4086-be2d-ed330eb5aa7a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.292260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.294217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.294501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.294800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] PATH_INFO: `/v3/projects/deb892c68f974ff692e7f9938589dec4/users/9aeb3a95f01b4458b53eff949be8c957/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.333980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb892c68f974ff692e7f9938589dec4, user_id=9aeb3a95f01b4458b53eff949be8c957, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.337124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.360100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 997/2017] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:05:59 2022] PUT /identity/v3/projects/deb892c68f974ff692e7f9938589dec4/users/9aeb3a95f01b4458b53eff949be8c957/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:05:59.376935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c239-011c-4ec7-a29b-e72b09e8cbe1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.377367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c239-011c-4ec7-a29b-e72b09e8cbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.377945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3c239-011c-4ec7-a29b-e72b09e8cbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.428930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f2d3c239-011c-4ec7-a29b-e72b09e8cbe1 None None] MFA Rules not processed for user `9aeb3a95f01b4458b53eff949be8c957`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:05:59.436773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f2d3c239-011c-4ec7-a29b-e72b09e8cbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:05:59.543218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1021/2018] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:05:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:05:59.552457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.639729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f7ec4-f92c-4799-ba4e-1a3dce5adc64 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.645199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.645827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.646101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.646362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.647143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.649051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.697822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 998/2019] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:05:59 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:59.700070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c239-011c-4ec7-a29b-e72b09e8cbe1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.721120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3c239-011c-4ec7-a29b-e72b09e8cbe1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.773818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:59.828077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.829103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.829384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.829745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.830491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.833111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.871063 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1022/2020] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:05:59 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:05:59.872887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.881527 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:59.892692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3f0a5-48fc-4415-88c9-91292562b402 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.901327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.902153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.902847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.903227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:05:59.904171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:05:59.906769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:05:59.924021 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 999/2021] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:05:59.928224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:05:59.948269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abcc93-0593-4a4f-a464-e20588fab29f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:05:59.960779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:05:59.961820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:05:59.966024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:05:59.966430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] PATH_INFO: `/v3/projects/8f92cb8977b24438b6325bd4ed213e24/users/9e1a9e5f4b514db888a3fe4cf607e7c7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:00.005352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f92cb8977b24438b6325bd4ed213e24, user_id=9e1a9e5f4b514db888a3fe4cf607e7c7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:00.008370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:00.038653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1023/2022] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:05:59 2022] PUT /identity/v3/projects/8f92cb8977b24438b6325bd4ed213e24/users/9e1a9e5f4b514db888a3fe4cf607e7c7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:00.042677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:00.073916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd92b8-0a96-4f4b-9b77-6a27a8cd020e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:00.262757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844e29-ed6c-4a65-ac84-4fb10d7b03ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:00.278710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844e29-ed6c-4a65-ac84-4fb10d7b03ae admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:00.278710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844e29-ed6c-4a65-ac84-4fb10d7b03ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:00.278710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844e29-ed6c-4a65-ac84-4fb10d7b03ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:00.278710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc844e29-ed6c-4a65-ac84-4fb10d7b03ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:00.278710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc844e29-ed6c-4a65-ac84-4fb10d7b03ae admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:00.302679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1000/2023] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:00.308603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:00.347610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc080-9a85-4ac1-a707-be88cdf26c51 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:00.355785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:00.356869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:00.357385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:00.357852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] PATH_INFO: `/v3/projects/8f92cb8977b24438b6325bd4ed213e24/users/9e1a9e5f4b514db888a3fe4cf607e7c7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:00.360814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f92cb8977b24438b6325bd4ed213e24, user_id=9e1a9e5f4b514db888a3fe4cf607e7c7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:00.364314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:00.377662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1024/2024] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:00 2022] PUT /identity/v3/projects/8f92cb8977b24438b6325bd4ed213e24/users/9e1a9e5f4b514db888a3fe4cf607e7c7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:00.388986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1dbf-2a8a-4d41-b547-827ab8a016bd None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:00.389287 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1dbf-2a8a-4d41-b547-827ab8a016bd None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:00.389581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f1dbf-2a8a-4d41-b547-827ab8a016bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:00.432366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-452f1dbf-2a8a-4d41-b547-827ab8a016bd None None] MFA Rules not processed for user `9e1a9e5f4b514db888a3fe4cf607e7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:00.433704 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-452f1dbf-2a8a-4d41-b547-827ab8a016bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:00.557403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1001/2025] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:00.573644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:00.575542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:00.667773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af127e-5b2f-4027-b811-cb8e28bc420f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:00.671812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca565c-2b92-4527-be96-8e80fc0a49d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:00.672526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca565c-2b92-4527-be96-8e80fc0a49d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:00.672862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca565c-2b92-4527-be96-8e80fc0a49d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:00.673195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca565c-2b92-4527-be96-8e80fc0a49d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:00.684480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca565c-2b92-4527-be96-8e80fc0a49d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:00.685931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca565c-2b92-4527-be96-8e80fc0a49d3 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:00.697062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1025/2026] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:01.784340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1dbf-2a8a-4d41-b547-827ab8a016bd None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:01.909271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f1dbf-2a8a-4d41-b547-827ab8a016bd None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:01.918870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:01.920245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:01.921044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:01.921044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] PATH_INFO: `/v3/users/9aeb3a95f01b4458b53eff949be8c957` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:01.923406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aeb3a95f01b4458b53eff949be8c957)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:01.938860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:01.956856 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:02.016418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aeb3a95f01b4458b53eff949be8c957'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.017531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aeb3a95f01b4458b53eff949be8c957'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.034809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aeb3a95f01b4458b53eff949be8c957'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.045347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aeb3a95f01b4458b53eff949be8c957'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.046171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aeb3a95f01b4458b53eff949be8c957'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.066455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1002/2027] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:01 2022] DELETE /identity/v3/users/9aeb3a95f01b4458b53eff949be8c957 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:02.071230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:02.071733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:02.072108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:02.094832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:02.096576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:02.169443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1026/2028] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:02.181700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:02.184251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:02.321749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022b104-d0fe-446b-958f-bf1a81473e3c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:02.326203 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:02.326945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:02.327288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:02.327636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:02.337882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:02.339484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:02.374764 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1003/2029] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:02.727732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:02.729171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:02.751314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfce4f-a5d6-4efd-892f-2addf48b5d52 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:02.756203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:02.756805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:02.757070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:02.757334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] PATH_INFO: `/v3/projects/deb892c68f974ff692e7f9938589dec4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:02.758509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb892c68f974ff692e7f9938589dec4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:02.760534 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:02.795515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:02.875430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb892c68f974ff692e7f9938589dec4', 'request_id': 'req-bcc6437f-85b0-40bf-841c-c460df8d129c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.883829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb892c68f974ff692e7f9938589dec4', 'request_id': 'req-bcc6437f-85b0-40bf-841c-c460df8d129c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.899549 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb892c68f974ff692e7f9938589dec4', 'request_id': 'req-bcc6437f-85b0-40bf-841c-c460df8d129c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.915545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] The token cache is being invalidate because project deb892c68f974ff692e7f9938589dec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:02.915545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.916027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:02.918685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1027/2030] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:02 2022] DELETE /identity/v3/projects/deb892c68f974ff692e7f9938589dec4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:02.925602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:02.940406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c217d8-249a-4ab7-9bc3-afa169a27e0f service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:03.045476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:03.045825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:03.046603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:03.047449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] PATH_INFO: `/v3/users/9e1a9e5f4b514db888a3fe4cf607e7c7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:03.049190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1a9e5f4b514db888a3fe4cf607e7c7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:03.052888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:03.111818 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:03.127716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1a9e5f4b514db888a3fe4cf607e7c7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:03.130104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1a9e5f4b514db888a3fe4cf607e7c7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:03.159672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1a9e5f4b514db888a3fe4cf607e7c7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:03.176915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1a9e5f4b514db888a3fe4cf607e7c7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:03.178872 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8fda1b80-9bff-413d-8f1a-061c43d5ccce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1a9e5f4b514db888a3fe4cf607e7c7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:03.197563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1004/2031] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:02 2022] DELETE /identity/v3/users/9e1a9e5f4b514db888a3fe4cf607e7c7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:03.806415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:03.808066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:03.838973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6437f-85b0-40bf-841c-c460df8d129c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:03.923665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:03.924595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:03.924908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:03.925238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] PATH_INFO: `/v3/projects/8f92cb8977b24438b6325bd4ed213e24` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:03.927884 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f92cb8977b24438b6325bd4ed213e24)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:03.932259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.034208 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f92cb8977b24438b6325bd4ed213e24', 'request_id': 'req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:04.050880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f92cb8977b24438b6325bd4ed213e24', 'request_id': 'req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:04.061992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f92cb8977b24438b6325bd4ed213e24', 'request_id': 'req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:04.077982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] The token cache is being invalidate because project 8f92cb8977b24438b6325bd4ed213e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:04.078461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:04.079135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9a0df8c5-570f-4c43-a1dc-ff8f36e65dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:04.080818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1028/2032] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:03 2022] DELETE /identity/v3/projects/8f92cb8977b24438b6325bd4ed213e24 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:04.087300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a32a25-60a4-45b3-b1dd-f893a527d191 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.087805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a32a25-60a4-45b3-b1dd-f893a527d191 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.087986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a32a25-60a4-45b3-b1dd-f893a527d191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.110598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-82a32a25-60a4-45b3-b1dd-f893a527d191 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:04.111814 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-82a32a25-60a4-45b3-b1dd-f893a527d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:04.190256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1005/2033] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:04.198157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd780e-c785-4abb-b0cf-659446110c3c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.198436 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd780e-c785-4abb-b0cf-659446110c3c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.198740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd780e-c785-4abb-b0cf-659446110c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.221489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9bbd780e-c785-4abb-b0cf-659446110c3c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:04.222848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9bbd780e-c785-4abb-b0cf-659446110c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:04.231908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1029/2034] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:04.236233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a32a25-60a4-45b3-b1dd-f893a527d191 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.253888 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a32a25-60a4-45b3-b1dd-f893a527d191 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.258684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.259343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.259625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.259892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.260568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:04.260868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:04.262568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.280161 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1006/2035] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:06:04.284430 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd780e-c785-4abb-b0cf-659446110c3c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.301532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd780e-c785-4abb-b0cf-659446110c3c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.307217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.307895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.308172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.308439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.309091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:04.311042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.349930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1030/2036] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:04 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:04.355279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.366354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2af5fc-a3de-4b68-a1b8-79f6872641b6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.441706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.442465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.442778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.443019 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.443660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:04.445632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.471699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1007/2037] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:04 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:04.475723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.486574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:04.491259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6be865-5b1e-4c7a-a65e-b7b752b9460d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.500798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.501726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.502096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.502405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.503238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:04.504931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.521246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1031/2038] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:04.522484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.533789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2d373-9b08-4681-862a-95119ec43dcc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.539325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab16723-1079-4bb0-a2f5-e319be9851f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.539963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab16723-1079-4bb0-a2f5-e319be9851f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.540241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab16723-1079-4bb0-a2f5-e319be9851f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.540511 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab16723-1079-4bb0-a2f5-e319be9851f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.541200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab16723-1079-4bb0-a2f5-e319be9851f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:04.542938 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab16723-1079-4bb0-a2f5-e319be9851f7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.555525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1008/2039] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:04.559647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.572588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd3baa-4fd5-4333-a5c1-bbc0857e899b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.577591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.578369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.578724 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.579056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] PATH_INFO: `/v3/projects/aaabcbd78d3d42f68e8bebc5148dc926/users/b9f3de2109154bd79a31c2c43757f137/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.601932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaabcbd78d3d42f68e8bebc5148dc926, user_id=b9f3de2109154bd79a31c2c43757f137, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:04.604941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.623060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1032/2040] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:04 2022] PUT /identity/v3/projects/aaabcbd78d3d42f68e8bebc5148dc926/users/b9f3de2109154bd79a31c2c43757f137/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:04.635193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115cc1f-77e2-40b8-8e3b-ff7adb9bd52e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.635858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115cc1f-77e2-40b8-8e3b-ff7adb9bd52e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.636781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115cc1f-77e2-40b8-8e3b-ff7adb9bd52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.675832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1115cc1f-77e2-40b8-8e3b-ff7adb9bd52e None None] MFA Rules not processed for user `b9f3de2109154bd79a31c2c43757f137`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:04.677554 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1115cc1f-77e2-40b8-8e3b-ff7adb9bd52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:04.687224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:04.759333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1009/2041] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:04.764150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.847050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35497546-a53d-4cf0-8bf0-a1dc12ce3a50 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.853211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.853916 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.854259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.854685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.855413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:04.857491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:04.893790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1033/2042] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:04 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:04.898191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115cc1f-77e2-40b8-8e3b-ff7adb9bd52e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:04.914411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115cc1f-77e2-40b8-8e3b-ff7adb9bd52e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:04.997637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:04.998215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:04.998658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:04.999246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:04.999751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:05.002124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:05.029730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1010/2043] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:04 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:05.034298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:05.081368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364c31e-f051-4d9b-bbe2-1c9418eef1c7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:05.086942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:05.088029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:05.088607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:05.089170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:05.089982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:05.091965 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:05.111381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:05.123548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da39d6-91d0-4cf2-862e-1fd78b4ff13e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:05.124413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1034/2044] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:05.132776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:05.133552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:05.133825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:05.134271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] PATH_INFO: `/v3/projects/74950fd4012f464f9c6c5f7e5de58794/users/0e911c1833e4493295c34ce2eb7ebff0/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:05.153860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74950fd4012f464f9c6c5f7e5de58794, user_id=0e911c1833e4493295c34ce2eb7ebff0, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:05.157358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:05.188027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:05.188504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1011/2045] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:05 2022] PUT /identity/v3/projects/74950fd4012f464f9c6c5f7e5de58794/users/0e911c1833e4493295c34ce2eb7ebff0/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:05.199903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc503206-f77b-46bd-9832-dfb31294c615 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:05.277991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff59251-1c38-4de8-9fbb-f8ce95859954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:05.279173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59251-1c38-4de8-9fbb-f8ce95859954 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:05.279786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59251-1c38-4de8-9fbb-f8ce95859954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:05.280345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff59251-1c38-4de8-9fbb-f8ce95859954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:05.281658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59251-1c38-4de8-9fbb-f8ce95859954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:05.285190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff59251-1c38-4de8-9fbb-f8ce95859954 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:05.304347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1035/2046] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:05.308940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:05.322940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed757d8c-18b1-4406-96ec-c073dab81406 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:05.330469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:05.331601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:05.331887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:05.332915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] PATH_INFO: `/v3/projects/74950fd4012f464f9c6c5f7e5de58794/users/0e911c1833e4493295c34ce2eb7ebff0/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:05.335981 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74950fd4012f464f9c6c5f7e5de58794, user_id=0e911c1833e4493295c34ce2eb7ebff0, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:05.338854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:05.352172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1012/2047] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:05 2022] PUT /identity/v3/projects/74950fd4012f464f9c6c5f7e5de58794/users/0e911c1833e4493295c34ce2eb7ebff0/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:05.362487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:05.362901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:05.363239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:05.398131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] MFA Rules not processed for user `0e911c1833e4493295c34ce2eb7ebff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:05.399553 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:05.433871 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:05.487084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1036/2048] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:05.497904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:05.499908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:05.568401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702db6-336f-400d-b411-aebf887a0e13 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:05.573417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:05.574131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:05.574406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:05.574723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:05.590475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:05.643629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:05.645352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:05.655976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1013/2049] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:07.323788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:07.327226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:07.588522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582eb0e-0ea0-4eef-b8c0-f041013399b0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:07.603052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:07.604365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:07.605075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:07.605648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:07.612946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:07.641028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:07.658120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:07.698854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1037/2050] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:10.613883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:10.615892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:10.627723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e589b-cb4d-42f5-8af0-dd730efd5d31 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:10.631525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:10.632149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:10.632417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:10.632698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:10.642707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:10.644140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:10.654043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1014/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:12.217331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:12.219151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:12.291928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcedad-b8ab-4f0e-b74a-d589569283c8 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:12.295592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:12.298755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:12.299028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:12.299315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:12.301463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:12.317592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:12.320484 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:12.336575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1038/2052] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:12.871094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:12.889937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ecd6f-29d6-4677-b4b4-d6ec64ec79f0 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:12.908330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68d97-df4b-49d8-b87d-9e56aad70dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:12.909548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68d97-df4b-49d8-b87d-9e56aad70dcb service nova] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:12.909828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68d97-df4b-49d8-b87d-9e56aad70dcb service nova] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:12.910281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68d97-df4b-49d8-b87d-9e56aad70dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:12.913745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-49c68d97-df4b-49d8-b87d-9e56aad70dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:12.934778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68d97-df4b-49d8-b87d-9e56aad70dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:12.936602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68d97-df4b-49d8-b87d-9e56aad70dcb service nova] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:12.950901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1015/2053] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:13.632542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:13.642296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54e329-feb6-44ad-9ce4-21d2c1b1ff05 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:13.648913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:13.649546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:13.649991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:13.650417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:13.652341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:13.718912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:13.734813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:13.736318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:13.748047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1039/2054] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:14.920624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668e742-7417-4d9d-a0d9-4e0d251a1b6b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:14.921587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668e742-7417-4d9d-a0d9-4e0d251a1b6b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:14.922154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668e742-7417-4d9d-a0d9-4e0d251a1b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:14.960199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-1668e742-7417-4d9d-a0d9-4e0d251a1b6b None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:14.962392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1668e742-7417-4d9d-a0d9-4e0d251a1b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:15.043346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1016/2055] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:06:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:15.057224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:15.058921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:15.153613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f3319-1dc9-4c75-80bc-89a75b81fa60 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:15.158648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9d5cc-23c2-44a2-828c-af40114c12bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:15.159289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9d5cc-23c2-44a2-828c-af40114c12bf service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:15.159803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9d5cc-23c2-44a2-828c-af40114c12bf service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:15.159931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9d5cc-23c2-44a2-828c-af40114c12bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:15.176686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9d5cc-23c2-44a2-828c-af40114c12bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:15.178379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9d5cc-23c2-44a2-828c-af40114c12bf service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:15.189292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1040/2056] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:06:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:06:15.683873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668e742-7417-4d9d-a0d9-4e0d251a1b6b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:15.714202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668e742-7417-4d9d-a0d9-4e0d251a1b6b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:15.721906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:15.722903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:15.723187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:15.723468 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] PATH_INFO: `/v3/users/b9f3de2109154bd79a31c2c43757f137` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:15.724894 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f3de2109154bd79a31c2c43757f137)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:15.727724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:15.806673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f3de2109154bd79a31c2c43757f137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:15.807761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f3de2109154bd79a31c2c43757f137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:15.834506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f3de2109154bd79a31c2c43757f137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:15.850272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f3de2109154bd79a31c2c43757f137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:15.852244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f3de2109154bd79a31c2c43757f137'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:15.887354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1017/2057] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:15 2022] DELETE /identity/v3/users/b9f3de2109154bd79a31c2c43757f137 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:15.894394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:15.895088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:15.895628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:15.942132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:15.943697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:16.065873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1041/2058] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:16.075534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:16.077102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:16.093403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:16.201857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85527710-34a5-47aa-9221-11b1fa1c0a66 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:16.207025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:16.208002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:16.208654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:16.209281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:16.231554 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:16.233531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:16.270182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1018/2059] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:17.121662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:17.124151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:17.141679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4840c5-e06a-4e19-a121-940a2ef3f061 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:17.146389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:17.147233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:17.147699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:17.148173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] PATH_INFO: `/v3/projects/aaabcbd78d3d42f68e8bebc5148dc926` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:17.149567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaabcbd78d3d42f68e8bebc5148dc926)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:17.151781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:17.256735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaabcbd78d3d42f68e8bebc5148dc926', 'request_id': 'req-638d13dd-a940-4ab7-9029-3bbacce0f399'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.271682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaabcbd78d3d42f68e8bebc5148dc926', 'request_id': 'req-638d13dd-a940-4ab7-9029-3bbacce0f399'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.290264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaabcbd78d3d42f68e8bebc5148dc926', 'request_id': 'req-638d13dd-a940-4ab7-9029-3bbacce0f399'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.312385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:17.320079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] The token cache is being invalidate because project aaabcbd78d3d42f68e8bebc5148dc926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:17.321442 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.323087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.325338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1042/2060] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:17 2022] DELETE /identity/v3/projects/aaabcbd78d3d42f68e8bebc5148dc926 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:17.329937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:17.345200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a1144-8430-4e1d-a038-1c9ab0e23dd5 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:17.510813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:17.511487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:17.511763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:17.512036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] PATH_INFO: `/v3/users/0e911c1833e4493295c34ce2eb7ebff0` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:17.515315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e911c1833e4493295c34ce2eb7ebff0)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:17.517557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:17.646885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e911c1833e4493295c34ce2eb7ebff0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.647735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e911c1833e4493295c34ce2eb7ebff0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.679411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e911c1833e4493295c34ce2eb7ebff0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.691195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e911c1833e4493295c34ce2eb7ebff0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.694073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-fcd42b26-390e-4b35-a4b8-d0b2fa020b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e911c1833e4493295c34ce2eb7ebff0'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:17.750437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1019/2061] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:17 2022] DELETE /identity/v3/users/0e911c1833e4493295c34ce2eb7ebff0 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:18.559671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:18.561431 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:18.587984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d13dd-a940-4ab7-9029-3bbacce0f399 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:18.715623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:18.716357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:18.716700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:18.716974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] PATH_INFO: `/v3/projects/74950fd4012f464f9c6c5f7e5de58794` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:18.719526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74950fd4012f464f9c6c5f7e5de58794)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:18.724920 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:18.853200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74950fd4012f464f9c6c5f7e5de58794', 'request_id': 'req-7a560776-d8ae-4c15-824c-331ae2b76147'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:18.868621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74950fd4012f464f9c6c5f7e5de58794', 'request_id': 'req-7a560776-d8ae-4c15-824c-331ae2b76147'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:18.882899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74950fd4012f464f9c6c5f7e5de58794', 'request_id': 'req-7a560776-d8ae-4c15-824c-331ae2b76147'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:18.909204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] The token cache is being invalidate because project 74950fd4012f464f9c6c5f7e5de58794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:18.909520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:18.912959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7a560776-d8ae-4c15-824c-331ae2b76147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:18.916090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1043/2062] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:18 2022] DELETE /identity/v3/projects/74950fd4012f464f9c6c5f7e5de58794 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:18.922497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:18.922948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:18.922948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:18.965875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:18.969476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:19.031457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:19.161769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1020/2063] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:19.171902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874137d-c4f1-4496-8aa1-800346a16bd8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.172229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874137d-c4f1-4496-8aa1-800346a16bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.172503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874137d-c4f1-4496-8aa1-800346a16bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.204743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.207102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:19.230985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e522902-40e0-4810-9b60-706fccd41116 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.231497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f874137d-c4f1-4496-8aa1-800346a16bd8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:19.233499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f874137d-c4f1-4496-8aa1-800346a16bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:19.242512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:19.246031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.246381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.246923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] PATH_INFO: `/v3/users/c3dd26a68dd14618bd8d26f5acc7ed0b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.248571 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3dd26a68dd14618bd8d26f5acc7ed0b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:19.250655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:19.254846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1044/2064] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:19.258435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874137d-c4f1-4496-8aa1-800346a16bd8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.273341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874137d-c4f1-4496-8aa1-800346a16bd8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.283530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:19.299099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.299700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.300069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.301721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:19.302242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:19.306969 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:19.324254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1045/2065] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:19.337445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.351776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a21f7-20af-4917-8872-03f6ce9b8619 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.363168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:19.364631 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.365175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.365584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.366946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:19.371372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:19.395623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3dd26a68dd14618bd8d26f5acc7ed0b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:19.398538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3dd26a68dd14618bd8d26f5acc7ed0b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:19.429231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3dd26a68dd14618bd8d26f5acc7ed0b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:19.441357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1046/2066] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:19 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:19.442951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3dd26a68dd14618bd8d26f5acc7ed0b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:19.444639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3dd26a68dd14618bd8d26f5acc7ed0b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:19.445638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.448570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:19.469299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1021/2067] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:19 2022] DELETE /identity/v3/users/c3dd26a68dd14618bd8d26f5acc7ed0b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:19.591833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:19.630283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf741e-e554-4441-a24d-271fdc99f552 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.795438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:19.796068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.796342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.796622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.797406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:19.814598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:19.840576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.843748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:19.853413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1047/2068] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:19 2022] POST /identity/v3/users => generated 288 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:19.858094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.864999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856af84f-af22-4d0a-97cb-cded9267f777 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.876714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0027db-9912-4583-a0e0-7aec1fe9dfd4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.878710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:19.879382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.879659 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.879937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] PATH_INFO: `/v3/projects/78405cdbebad4931a9e471e5b4728cb9` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.882913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:19.883574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.883839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.884111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.884585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78405cdbebad4931a9e471e5b4728cb9)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:19.884793 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:19.886413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:19.886636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:19.907076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1048/2069] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:19.911837 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.923185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda8769-7bf5-451e-bc78-ac65f3d5c3ab admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.929366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:19.930328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:19.930748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:19.931201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:19.932150 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:19.934021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:19.956787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1049/2070] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:19.961779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:19.968557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78405cdbebad4931a9e471e5b4728cb9', 'request_id': 'req-a1e28d5a-5908-4de7-9983-a1292603bd2c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:19.978213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78405cdbebad4931a9e471e5b4728cb9', 'request_id': 'req-a1e28d5a-5908-4de7-9983-a1292603bd2c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:19.991234 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acee867-a4eb-4199-873c-6249dce4349f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:19.996161 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78405cdbebad4931a9e471e5b4728cb9', 'request_id': 'req-a1e28d5a-5908-4de7-9983-a1292603bd2c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:20.014893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] The token cache is being invalidate because project 78405cdbebad4931a9e471e5b4728cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:20.015524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:20.016469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1e28d5a-5908-4de7-9983-a1292603bd2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:20.018991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1022/2071] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:19 2022] DELETE /identity/v3/projects/78405cdbebad4931a9e471e5b4728cb9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:20.026229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057639e-7e1d-421f-952e-705887332f1b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.027222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057639e-7e1d-421f-952e-705887332f1b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.034053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057639e-7e1d-421f-952e-705887332f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.061558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f057639e-7e1d-421f-952e-705887332f1b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:20.062839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f057639e-7e1d-421f-952e-705887332f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:20.091429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:20.100228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381166b-cc96-42ed-a241-f3f7f7b207be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.100909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381166b-cc96-42ed-a241-f3f7f7b207be admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.101186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381166b-cc96-42ed-a241-f3f7f7b207be admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.101459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381166b-cc96-42ed-a241-f3f7f7b207be admin admin] PATH_INFO: `/v3/projects/a0d7b23839f94e24a2e372b5361bcd17/users/025b9da00a9d414c8edb64502f5194f5/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.122873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381166b-cc96-42ed-a241-f3f7f7b207be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d7b23839f94e24a2e372b5361bcd17, user_id=025b9da00a9d414c8edb64502f5194f5, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.126533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381166b-cc96-42ed-a241-f3f7f7b207be admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.145819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1050/2072] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:19 2022] PUT /identity/v3/projects/a0d7b23839f94e24a2e372b5361bcd17/users/025b9da00a9d414c8edb64502f5194f5/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:20.160476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.160858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.161185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.162636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1023/2073] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:20.170883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5afe43-1fff-4516-8301-b0ab67742413 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.171327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5afe43-1fff-4516-8301-b0ab67742413 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.171753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5afe43-1fff-4516-8301-b0ab67742413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.193739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-3d5afe43-1fff-4516-8301-b0ab67742413 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:20.195017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3d5afe43-1fff-4516-8301-b0ab67742413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:20.203756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] MFA Rules not processed for user `025b9da00a9d414c8edb64502f5194f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:20.205607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:20.260951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:20.274346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1024/2074] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:20.278869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5afe43-1fff-4516-8301-b0ab67742413 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:20.289946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5afe43-1fff-4516-8301-b0ab67742413 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:20.295405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.296081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.296361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.296673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.297273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:20.297572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.299276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.302599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1051/2075] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:20.312317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:20.314048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1025/2076] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:06:20.314181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:20.318699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:20.329989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6fe6-7560-4378-9478-6c5cf9672afc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:20.336789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.337421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.337762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.338013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.338641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.340613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.394266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1026/2077] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:20 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:20.398642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:20.431765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0906b6-f2d5-443c-99b6-3279c3e18b6b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:20.517035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e82012-ab3c-4e40-9e54-0bcff43b7041 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:20.523679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.524381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.524664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.525232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.525923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.527966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.540182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78db6f3cf17421898e1597c65998fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.541247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.541743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.542227 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.567208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1027/2078] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:20 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:20.570143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:20.586378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf171-ab64-4735-ab69-eedbe349848d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:20.600223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.601001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.601273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.601548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.602213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.603905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.616602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1028/2079] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:20.628347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:20.634711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.636236 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.640867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69b989-16a4-49f5-88fd-6eb43f0923e1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:20.648223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5a47-fb29-4639-9c78-7b91dafe5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.649640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a47-fb29-4639-9c78-7b91dafe5a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.649959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a47-fb29-4639-9c78-7b91dafe5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.650232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a47-fb29-4639-9c78-7b91dafe5a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.650963 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d5a47-fb29-4639-9c78-7b91dafe5a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.652656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d5a47-fb29-4639-9c78-7b91dafe5a4d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.652950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1052/2080] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:20.655749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:20.674311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1029/2081] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:20.680661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:20.697338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b961b8b-77f1-476d-a21b-ca4f57bb327d service glance] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:20.707613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:20.708372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.708658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.708932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] PATH_INFO: `/v3/projects/2b1ef1c71aa642b0af565b32595bfc7d/users/97c5cb3b353d4117b5c3c4b96aa57360/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.735362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1ef1c71aa642b0af565b32595bfc7d, user_id=97c5cb3b353d4117b5c3c4b96aa57360, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:20.740754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:20.762651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1053/2082] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:20 2022] PUT /identity/v3/projects/2b1ef1c71aa642b0af565b32595bfc7d/users/97c5cb3b353d4117b5c3c4b96aa57360/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:20.769589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e3df-73bb-4fa5-a7b9-06d7f8424c83 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:20.770133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e3df-73bb-4fa5-a7b9-06d7f8424c83 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:20.770622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2e3df-73bb-4fa5-a7b9-06d7f8424c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:20.819864 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-fee2e3df-73bb-4fa5-a7b9-06d7f8424c83 None None] MFA Rules not processed for user `97c5cb3b353d4117b5c3c4b96aa57360`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:20.830133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fee2e3df-73bb-4fa5-a7b9-06d7f8424c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:20.983012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1030/2083] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:21.083596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:21.085699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:21.135610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:21.224383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303eb6f-3d65-49af-a9e8-7809ab539524 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:21.232502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5779cfc-efff-452e-acc1-744b3e334bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:21.233331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779cfc-efff-452e-acc1-744b3e334bd1 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:21.233564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779cfc-efff-452e-acc1-744b3e334bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:21.233830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5779cfc-efff-452e-acc1-744b3e334bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:21.244951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779cfc-efff-452e-acc1-744b3e334bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:21.246748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5779cfc-efff-452e-acc1-744b3e334bd1 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:21.271635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1054/2084] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:21.643190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2e3df-73bb-4fa5-a7b9-06d7f8424c83 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:21.735899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2e3df-73bb-4fa5-a7b9-06d7f8424c83 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:21.741433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:21.742752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:21.742752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:21.742752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] PATH_INFO: `/v3/users/97c5cb3b353d4117b5c3c4b96aa57360` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:21.744033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c5cb3b353d4117b5c3c4b96aa57360)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:21.746038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:21.835061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c5cb3b353d4117b5c3c4b96aa57360'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:21.836334 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c5cb3b353d4117b5c3c4b96aa57360'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:21.853844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c5cb3b353d4117b5c3c4b96aa57360'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:21.868148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c5cb3b353d4117b5c3c4b96aa57360'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:21.869385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c5cb3b353d4117b5c3c4b96aa57360'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:21.899222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1031/2085] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:21 2022] DELETE /identity/v3/users/97c5cb3b353d4117b5c3c4b96aa57360 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:21.903907 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:21.904467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:21.904467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:21.926904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:21.928267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:22.021405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1055/2086] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:22.033479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:22.034816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:22.046849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:22.108275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9ff23-aa3b-4ad2-b8af-6a160f63626a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:22.112244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e464ef-b8b0-4fe8-adb4-3cc9b542e9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:22.112880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e464ef-b8b0-4fe8-adb4-3cc9b542e9da service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:22.113156 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e464ef-b8b0-4fe8-adb4-3cc9b542e9da service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:22.113424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e464ef-b8b0-4fe8-adb4-3cc9b542e9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:22.127705 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e464ef-b8b0-4fe8-adb4-3cc9b542e9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:22.129985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e464ef-b8b0-4fe8-adb4-3cc9b542e9da service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:22.141770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1032/2087] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:22.536303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:22.537864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:22.550986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82a4ed-a775-4f54-ad90-aff0c93b02d8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:22.556062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:22.556824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:22.557339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:22.557622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] PATH_INFO: `/v3/projects/2b1ef1c71aa642b0af565b32595bfc7d` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:22.559834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1ef1c71aa642b0af565b32595bfc7d)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:22.561956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:22.639198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1ef1c71aa642b0af565b32595bfc7d', 'request_id': 'req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:22.645922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1ef1c71aa642b0af565b32595bfc7d', 'request_id': 'req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:22.654218 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1ef1c71aa642b0af565b32595bfc7d', 'request_id': 'req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:22.670819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] The token cache is being invalidate because project 2b1ef1c71aa642b0af565b32595bfc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:22.671151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:22.671746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1994cfd7-4e19-4b02-ba16-0d6a49a9890b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:22.673261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1056/2088] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:22 2022] DELETE /identity/v3/projects/2b1ef1c71aa642b0af565b32595bfc7d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:22.678657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011601a-b138-40ed-9fb2-8968c07ad0a3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:22.679000 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011601a-b138-40ed-9fb2-8968c07ad0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:22.679277 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011601a-b138-40ed-9fb2-8968c07ad0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:22.702691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-9011601a-b138-40ed-9fb2-8968c07ad0a3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:22.703939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9011601a-b138-40ed-9fb2-8968c07ad0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:22.776418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1033/2089] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:22.786611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25f7d-af41-49b4-9557-e80f4a856ca5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:22.786611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25f7d-af41-49b4-9557-e80f4a856ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:22.786611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e25f7d-af41-49b4-9557-e80f4a856ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:22.807958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-58e25f7d-af41-49b4-9557-e80f4a856ca5 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:22.809599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-58e25f7d-af41-49b4-9557-e80f4a856ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:22.822543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1057/2090] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:22.824072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011601a-b138-40ed-9fb2-8968c07ad0a3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:22.834419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011601a-b138-40ed-9fb2-8968c07ad0a3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:22.839699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:22.840660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:22.841015 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:22.841281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:22.841955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:22.842256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:22.844355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:22.856812 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1034/2091] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:06:22.861499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e25f7d-af41-49b4-9557-e80f4a856ca5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:22.871541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e25f7d-af41-49b4-9557-e80f4a856ca5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:22.876342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:22.876945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:22.877215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:22.877476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:22.878124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:22.880070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:22.911022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1058/2092] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:22 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:22.917748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:22.930531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fee8-0ea0-4ada-8388-b455d525752a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.003110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.003732 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.004007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.004275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.004919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.006980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.034215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1035/2093] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:22 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:23.036497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.043129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:23.049945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b07ce-fd33-43ef-9726-27a2967d1967 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.058242 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.059005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.059367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.059733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.060473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.062874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.074706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1059/2094] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:23.079107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.090940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca053e7a-8a6f-4822-98df-68dd4151bd10 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.095940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba67699-3afb-4390-8da0-1c0000e0c12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.096572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba67699-3afb-4390-8da0-1c0000e0c12c admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.096854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba67699-3afb-4390-8da0-1c0000e0c12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.097125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba67699-3afb-4390-8da0-1c0000e0c12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.097867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba67699-3afb-4390-8da0-1c0000e0c12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.099689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba67699-3afb-4390-8da0-1c0000e0c12c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.113474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1036/2095] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:23.119144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.130131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3d821-909d-4b4a-8150-92b3281aad32 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.135269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.135961 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.136237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.136561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] PATH_INFO: `/v3/projects/65c3855237504568ba125a0fb74a4ec8/users/dfa51f646dd04d8393b05bfcf2bf2636/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.153600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c3855237504568ba125a0fb74a4ec8, user_id=dfa51f646dd04d8393b05bfcf2bf2636, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.156536 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.182237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1060/2096] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:23 2022] PUT /identity/v3/projects/65c3855237504568ba125a0fb74a4ec8/users/dfa51f646dd04d8393b05bfcf2bf2636/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:23.185185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c50f12-b63e-4332-81d8-2d8e836594d2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.185515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c50f12-b63e-4332-81d8-2d8e836594d2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.185728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c50f12-b63e-4332-81d8-2d8e836594d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.227235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-23c50f12-b63e-4332-81d8-2d8e836594d2 None None] MFA Rules not processed for user `dfa51f646dd04d8393b05bfcf2bf2636`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:23.228636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-23c50f12-b63e-4332-81d8-2d8e836594d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:23.233321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:23.319965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1037/2097] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:23.325162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.438432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783f2cb-79e5-4c51-aa5f-1cf1e50b951a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.444318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.445023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.445310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.445589 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.446587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.452305 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.498080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1061/2098] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:23 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:23.500258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c50f12-b63e-4332-81d8-2d8e836594d2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.520425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c50f12-b63e-4332-81d8-2d8e836594d2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.630860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.631654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.632025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.633038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.633710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.635718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.663748 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1038/2099] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:23 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:23.669323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.691067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519390-4f0c-4edd-94d2-dd597b81a2ae admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.697617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.698450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.698858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.699173 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.700094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.701885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.715750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1062/2100] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:23.719878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.731218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcae1e-e718-4a25-8acf-cc58e2f98e06 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.736070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.736773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.737048 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.737321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] PATH_INFO: `/v3/projects/cba5a17605404b5ebff883f4e75edcea/users/fcb8845f81ce44cc8062d87bf709d35c/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.757252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba5a17605404b5ebff883f4e75edcea, user_id=fcb8845f81ce44cc8062d87bf709d35c, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.760314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.786465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1039/2101] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:23 2022] PUT /identity/v3/projects/cba5a17605404b5ebff883f4e75edcea/users/fcb8845f81ce44cc8062d87bf709d35c/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:23.788701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.800072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c768891-b993-4eb8-8d94-639b7e3fb131 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.870527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48909af-94cf-4797-8edb-59bc40b37287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.871086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48909af-94cf-4797-8edb-59bc40b37287 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.871356 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48909af-94cf-4797-8edb-59bc40b37287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.871621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48909af-94cf-4797-8edb-59bc40b37287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.872262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48909af-94cf-4797-8edb-59bc40b37287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.873861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48909af-94cf-4797-8edb-59bc40b37287 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.884543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1063/2102] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:23.889095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:23.900341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538b70-0b6f-4965-9563-77d83b01b112 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:23.904987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:23.905643 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.905921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.906192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] PATH_INFO: `/v3/projects/cba5a17605404b5ebff883f4e75edcea/users/fcb8845f81ce44cc8062d87bf709d35c/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.908167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba5a17605404b5ebff883f4e75edcea, user_id=fcb8845f81ce44cc8062d87bf709d35c, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:23.910870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:23.924031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1040/2103] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:23 2022] PUT /identity/v3/projects/cba5a17605404b5ebff883f4e75edcea/users/fcb8845f81ce44cc8062d87bf709d35c/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:23.935809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39c88-8089-438d-b970-6aab5a5c1477 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:23.936377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39c88-8089-438d-b970-6aab5a5c1477 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:23.936377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e39c88-8089-438d-b970-6aab5a5c1477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:23.966189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b9e39c88-8089-438d-b970-6aab5a5c1477 None None] MFA Rules not processed for user `fcb8845f81ce44cc8062d87bf709d35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:23.967476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b9e39c88-8089-438d-b970-6aab5a5c1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:24.001377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:24.055092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1064/2104] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:24.067177 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:24.069385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:24.131604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec144ce-668b-4d13-94eb-9a6870015eff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:24.135475 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:24.136238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:24.136514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:24.136780 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:24.146088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:24.147581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:24.152603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:24.158338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1041/2105] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:24.246114 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e39c88-8089-438d-b970-6aab5a5c1477 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:24.256836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e39c88-8089-438d-b970-6aab5a5c1477 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:24.261161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dee22c-e6bc-425c-9b8b-d444ccc49a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:24.261689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee22c-e6bc-425c-9b8b-d444ccc49a4f service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:24.261960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee22c-e6bc-425c-9b8b-d444ccc49a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:24.262222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dee22c-e6bc-425c-9b8b-d444ccc49a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:24.323053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee22c-e6bc-425c-9b8b-d444ccc49a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:24.324529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dee22c-e6bc-425c-9b8b-d444ccc49a4f service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:24.333976 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1065/2106] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:31.612942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:31.684956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f10a39-5b7a-4868-8979-8c5f38f7db16 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:31.692896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:31.692896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:31.692896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:31.692896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] PATH_INFO: `/v3/users/dfa51f646dd04d8393b05bfcf2bf2636` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:31.693521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa51f646dd04d8393b05bfcf2bf2636)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:31.694810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:31.755694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa51f646dd04d8393b05bfcf2bf2636'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:31.756555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa51f646dd04d8393b05bfcf2bf2636'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:31.771038 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa51f646dd04d8393b05bfcf2bf2636'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:31.779401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa51f646dd04d8393b05bfcf2bf2636'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:31.781036 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa51f646dd04d8393b05bfcf2bf2636'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:31.798416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1042/2107] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:31 2022] DELETE /identity/v3/users/dfa51f646dd04d8393b05bfcf2bf2636 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:31.803424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:31.803914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:31.804020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:31.825944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:31.827551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:31.899556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1066/2108] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:31.909877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:31.911357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:31.980286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd4686-571e-4dda-aae8-9f9336bc5c30 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:31.986391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:31.987132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:31.987408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:31.987679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:32.003081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:32.003081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:32.020942 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1043/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:32.467989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:32.471109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:32.490457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59405bff-1f02-429c-aca6-68a3a64e9100 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:32.501558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:32.502372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:32.503032 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:32.503545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] PATH_INFO: `/v3/projects/65c3855237504568ba125a0fb74a4ec8` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:32.505832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c3855237504568ba125a0fb74a4ec8)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:32.510417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:32.584240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c3855237504568ba125a0fb74a4ec8', 'request_id': 'req-25ea7533-d20d-462d-bd7e-bb2383686860'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.602766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c3855237504568ba125a0fb74a4ec8', 'request_id': 'req-25ea7533-d20d-462d-bd7e-bb2383686860'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.609975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:32.619317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c3855237504568ba125a0fb74a4ec8', 'request_id': 'req-25ea7533-d20d-462d-bd7e-bb2383686860'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.636978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] The token cache is being invalidate because project 65c3855237504568ba125a0fb74a4ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:32.637803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.638705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.640382 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1067/2110] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:32 2022] DELETE /identity/v3/projects/65c3855237504568ba125a0fb74a4ec8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:32.645078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:32.656447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97f86-8084-448e-8768-e7f5e0da9947 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:32.679119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:32.737758 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:32.738418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:32.738730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:32.738999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] PATH_INFO: `/v3/users/fcb8845f81ce44cc8062d87bf709d35c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:32.740230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb8845f81ce44cc8062d87bf709d35c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:32.742362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:32.797263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb8845f81ce44cc8062d87bf709d35c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.797919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb8845f81ce44cc8062d87bf709d35c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.811630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb8845f81ce44cc8062d87bf709d35c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.821153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb8845f81ce44cc8062d87bf709d35c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.821910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f97d92e5-48a2-4ab0-a2bc-58622dc1683c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb8845f81ce44cc8062d87bf709d35c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:32.836781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1044/2111] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:32 2022] DELETE /identity/v3/users/fcb8845f81ce44cc8062d87bf709d35c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:33.134938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.136443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:33.154067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea7533-d20d-462d-bd7e-bb2383686860 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.218450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.219144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.219424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.219697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] PATH_INFO: `/v3/projects/cba5a17605404b5ebff883f4e75edcea` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.220861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba5a17605404b5ebff883f4e75edcea)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.223354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.280523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.280846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.281105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.296144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba5a17605404b5ebff883f4e75edcea', 'request_id': 'req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:33.307686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba5a17605404b5ebff883f4e75edcea', 'request_id': 'req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:33.308688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:33.310622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:33.324525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba5a17605404b5ebff883f4e75edcea', 'request_id': 'req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:33.344755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] The token cache is being invalidate because project cba5a17605404b5ebff883f4e75edcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:33.345316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:33.346193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3245adcc-5d80-485c-8d6b-9dd4bc6f83d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:33.348806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1068/2112] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:33 2022] DELETE /identity/v3/projects/cba5a17605404b5ebff883f4e75edcea => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:33.355932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ebe6f-2793-4b32-8292-07b4bcacd86a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.356617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ebe6f-2793-4b32-8292-07b4bcacd86a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.356750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ebe6f-2793-4b32-8292-07b4bcacd86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.387748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-618ebe6f-2793-4b32-8292-07b4bcacd86a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:33.389777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-618ebe6f-2793-4b32-8292-07b4bcacd86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:33.434724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1045/2113] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 11 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:33.450137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.452472 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:33.518712 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1069/2114] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:33.526082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34330290-e84b-4c71-a7d0-ea3565edb40c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.526386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34330290-e84b-4c71-a7d0-ea3565edb40c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.526682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34330290-e84b-4c71-a7d0-ea3565edb40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.531005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:33.552060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-34330290-e84b-4c71-a7d0-ea3565edb40c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:33.553295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-34330290-e84b-4c71-a7d0-ea3565edb40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:33.563248 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1070/2115] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:33.567981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34330290-e84b-4c71-a7d0-ea3565edb40c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.575577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160e9f6-546b-4ca7-9f29-e1cb21fbd9d7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.577336 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34330290-e84b-4c71-a7d0-ea3565edb40c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.582226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.582876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.583164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.583418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.584117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:33.584369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.585289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.586025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.586735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.587331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.587979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.588718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:33.602718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1071/2116] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:33.603158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.606155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.608264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.618837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1046/2117] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:06:33.620775 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1a301-efb1-48a6-9e22-784313a6816c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.626517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.627303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.627843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.628118 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.628822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.630962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.668904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1072/2118] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:33 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:33.674357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.699979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0caf5-cb44-4424-8521-8361d57c8e60 service swift] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.784178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.784849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.785120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.785473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.786008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.792473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.820346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1047/2119] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:33 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:33.823232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.834202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f38d16-94e8-4ee6-97ea-9b27141b2525 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.852649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.853289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.853561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.853822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.854474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.856141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.870008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1073/2120] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:33.874024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.884843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c18bed-24b1-4dd2-8a4e-322fa5032572 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.889859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cbdc5-3f8b-4f42-b957-8fbfd16b32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.890495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cbdc5-3f8b-4f42-b957-8fbfd16b32d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.890900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cbdc5-3f8b-4f42-b957-8fbfd16b32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.891190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cbdc5-3f8b-4f42-b957-8fbfd16b32d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.891820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cbdc5-3f8b-4f42-b957-8fbfd16b32d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.893562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cbdc5-3f8b-4f42-b957-8fbfd16b32d7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.909134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1048/2121] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:33.910431 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:33.927663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d236a34-6c47-4000-a96c-011b7a5e89cf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:33.934408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:33.935180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:33.935454 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:33.935727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] PATH_INFO: `/v3/projects/1fd43d3f057749c2b67de083f774e777/users/f5edb65eb7254f48b50678d4d4362bc8/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:33.958232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd43d3f057749c2b67de083f774e777, user_id=f5edb65eb7254f48b50678d4d4362bc8, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:33.962127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:33.988206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1074/2122] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:33 2022] PUT /identity/v3/projects/1fd43d3f057749c2b67de083f774e777/users/f5edb65eb7254f48b50678d4d4362bc8/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:34.000756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872034a-ded9-4e39-a9cc-8bd53fbef6d7 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.001100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872034a-ded9-4e39-a9cc-8bd53fbef6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.001299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872034a-ded9-4e39-a9cc-8bd53fbef6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.033725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4872034a-ded9-4e39-a9cc-8bd53fbef6d7 None None] MFA Rules not processed for user `f5edb65eb7254f48b50678d4d4362bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:34.034989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4872034a-ded9-4e39-a9cc-8bd53fbef6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:34.113753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1049/2123] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:34.114979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.180710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b639fa-3f66-4808-8466-b71c737acead admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.185825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.186533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.186903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.187277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.187956 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.189932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:34.222737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1075/2124] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:34 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:34.223833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872034a-ded9-4e39-a9cc-8bd53fbef6d7 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.235027 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872034a-ded9-4e39-a9cc-8bd53fbef6d7 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.282049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:34.303556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.304222 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.304614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.304875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.305667 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.309809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:34.338585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1050/2125] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:34 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:34.340413 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.351906 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199eff-1e55-4c84-9d86-016b1d3ac52d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.356778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.357472 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.357810 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.358167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.359023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.360696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:34.372130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1076/2126] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:34.376540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.387331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341e3a4-2607-4666-a4c5-187ac6b05666 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.392178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.392781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.393057 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.393333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] PATH_INFO: `/v3/projects/bfc84d8e876a43beb2f4b7da1de27a44/users/7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.418097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc84d8e876a43beb2f4b7da1de27a44, user_id=7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.421491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:34.435913 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1051/2127] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:34 2022] PUT /identity/v3/projects/bfc84d8e876a43beb2f4b7da1de27a44/users/7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:34.440025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.450251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f4fb-c6f9-445e-b5b2-0b9e70672678 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.515034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a62a1e-6b96-4107-83c8-3a5250914b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.515671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a62a1e-6b96-4107-83c8-3a5250914b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.515940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a62a1e-6b96-4107-83c8-3a5250914b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.516200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a62a1e-6b96-4107-83c8-3a5250914b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.516850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a62a1e-6b96-4107-83c8-3a5250914b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.518452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a62a1e-6b96-4107-83c8-3a5250914b6e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:34.528988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1077/2128] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:34.533145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.544175 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92374594-a849-4076-9e3d-d0fb05d5893d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.548834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.549501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.549769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.550033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] PATH_INFO: `/v3/projects/bfc84d8e876a43beb2f4b7da1de27a44/users/7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.552221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc84d8e876a43beb2f4b7da1de27a44, user_id=7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.554999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:34.565884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1052/2129] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:34 2022] PUT /identity/v3/projects/bfc84d8e876a43beb2f4b7da1de27a44/users/7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:34.576301 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12284b5-e6a4-4641-a2d2-513f2135fc6c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.576582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12284b5-e6a4-4641-a2d2-513f2135fc6c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.576877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12284b5-e6a4-4641-a2d2-513f2135fc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.597860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:34.608937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-e12284b5-e6a4-4641-a2d2-513f2135fc6c None None] MFA Rules not processed for user `7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:34.610196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e12284b5-e6a4-4641-a2d2-513f2135fc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:34.692616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1078/2130] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:34.706094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.707936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:34.776491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc36ce-967d-43b3-9fa2-c8943ba9af38 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.781028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56d2ce-e00d-4931-aeb7-07aee8ae6c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.781819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d2ce-e00d-4931-aeb7-07aee8ae6c39 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.782096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d2ce-e00d-4931-aeb7-07aee8ae6c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.782375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56d2ce-e00d-4931-aeb7-07aee8ae6c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.793005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56d2ce-e00d-4931-aeb7-07aee8ae6c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.794717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56d2ce-e00d-4931-aeb7-07aee8ae6c39 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:34.806875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1053/2131] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:34.886348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12284b5-e6a4-4641-a2d2-513f2135fc6c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:34.961714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12284b5-e6a4-4641-a2d2-513f2135fc6c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:34.966225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:34.966898 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:34.967172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:34.967439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] PATH_INFO: `/v3/users/f5edb65eb7254f48b50678d4d4362bc8` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:34.968690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5edb65eb7254f48b50678d4d4362bc8)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:34.970508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:35.021585 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5edb65eb7254f48b50678d4d4362bc8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.022435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5edb65eb7254f48b50678d4d4362bc8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.031731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5edb65eb7254f48b50678d4d4362bc8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.041819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5edb65eb7254f48b50678d4d4362bc8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.057541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5edb65eb7254f48b50678d4d4362bc8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.064184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1079/2132] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:34 2022] DELETE /identity/v3/users/f5edb65eb7254f48b50678d4d4362bc8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:35.068898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:35.069181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:35.069438 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:35.090693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:35.091905 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:35.165522 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1054/2133] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:35.178945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:35.180588 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:35.200769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:35.250327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3613-6a16-4e37-8890-b306947f4cbf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:35.254672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:35.255296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:35.255567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:35.255828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:35.268950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:35.271016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:35.284129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1080/2134] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:35.596928 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:35.598375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:35.618194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9134b4b-a55a-48a7-a486-81106e97b1c2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:35.623355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:35.624017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:35.624351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:35.624560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] PATH_INFO: `/v3/projects/1fd43d3f057749c2b67de083f774e777` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:35.626086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd43d3f057749c2b67de083f774e777)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:35.627644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:35.711209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:35.726406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd43d3f057749c2b67de083f774e777', 'request_id': 'req-d4b3c5a1-3723-49d1-8c53-a438913ee828'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.737955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd43d3f057749c2b67de083f774e777', 'request_id': 'req-d4b3c5a1-3723-49d1-8c53-a438913ee828'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.749424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd43d3f057749c2b67de083f774e777', 'request_id': 'req-d4b3c5a1-3723-49d1-8c53-a438913ee828'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.767694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] The token cache is being invalidate because project 1fd43d3f057749c2b67de083f774e777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:35.767985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.769488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.771375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1055/2135] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:35 2022] DELETE /identity/v3/projects/1fd43d3f057749c2b67de083f774e777 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:35.775708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:35.788586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ed2e2-cd89-4027-8fcc-befe6fcdf4bc service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:35.852369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:35.853178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:35.853459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:35.854872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] PATH_INFO: `/v3/users/7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:35.858748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:35.861123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:35.912607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.913611 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.925180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.933457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.947798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a1dd21c9-369e-40e1-ae1b-cd8152e00a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:35.954732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1081/2136] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:35 2022] DELETE /identity/v3/users/7bf7e1a8a07f4ca2ba8f2c8d1d9ea18f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:36.252664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.254209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:36.267929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c5a1-3723-49d1-8c53-a438913ee828 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.333139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.334074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.334419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.334790 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] PATH_INFO: `/v3/projects/bfc84d8e876a43beb2f4b7da1de27a44` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.336795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc84d8e876a43beb2f4b7da1de27a44)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.339727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.392701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc84d8e876a43beb2f4b7da1de27a44', 'request_id': 'req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.398481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc84d8e876a43beb2f4b7da1de27a44', 'request_id': 'req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.408003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc84d8e876a43beb2f4b7da1de27a44', 'request_id': 'req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.420629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] The token cache is being invalidate because project bfc84d8e876a43beb2f4b7da1de27a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:36.420910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.421552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2dce5c70-d90b-4b2d-90e8-f81c34d3b763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.423090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1056/2137] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:36 2022] DELETE /identity/v3/projects/bfc84d8e876a43beb2f4b7da1de27a44 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:36.428304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571a93-6b82-42df-8828-a3734b84ea12 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.428773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571a93-6b82-42df-8828-a3734b84ea12 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.428883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571a93-6b82-42df-8828-a3734b84ea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.449672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-03571a93-6b82-42df-8828-a3734b84ea12 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:36.451089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-03571a93-6b82-42df-8828-a3734b84ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:36.485970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:36.524905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1082/2138] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:36.533114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d225-dcea-4c61-8d2a-94e17428d634 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.533464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d225-dcea-4c61-8d2a-94e17428d634 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.533794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d225-dcea-4c61-8d2a-94e17428d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.555060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-2a59d225-dcea-4c61-8d2a-94e17428d634 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:36.556303 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2a59d225-dcea-4c61-8d2a-94e17428d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:36.565248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1057/2139] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:36.569664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571a93-6b82-42df-8828-a3734b84ea12 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.579674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571a93-6b82-42df-8828-a3734b84ea12 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.584485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.584997 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.585272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.585538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.586252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:36.586594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.588177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.600219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1083/2140] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:36.605080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59d225-dcea-4c61-8d2a-94e17428d634 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.615191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59d225-dcea-4c61-8d2a-94e17428d634 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.620348 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.620941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.621210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.621471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.622104 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.624072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.654605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1058/2141] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:36 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:36.658477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.670060 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029ede8-2282-4dc3-bc6f-4ca71464c5a2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.729360 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.729958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.730229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.730488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.731137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.733162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.761354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1084/2142] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:36 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:36.765638 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.776573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6f71-1bc4-4561-abba-508a1674526f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.782413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.783085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.783359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.783622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.784400 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.786173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.798020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1059/2143] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:36.801524 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.812326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa8eb-87e1-41c5-ba06-8801205ca945 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.817826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.818438 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.818725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.819006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.819648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.821357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.833231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1085/2144] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:36.837529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.839950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:36.841780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:36.848479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac52d-5ce4-4c48-88bb-9ed5af09437d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.853652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e227e93-5f50-4c09-9f2d-d141de8d2a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.854327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227e93-5f50-4c09-9f2d-d141de8d2a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.854623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227e93-5f50-4c09-9f2d-d141de8d2a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.854891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e227e93-5f50-4c09-9f2d-d141de8d2a70 admin admin] PATH_INFO: `/v3/projects/42a603ecdfbf4f7b8a6da51c7348b3a4/users/576c840d1fc5419285063c4b44f97c13/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.857601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eb494-51fb-4728-99ee-74d5e697575b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:36.869149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:36.873289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:36.873930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.874273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.874501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] PATH_INFO: `/v3/users/025b9da00a9d414c8edb64502f5194f5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.875412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e227e93-5f50-4c09-9f2d-d141de8d2a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a603ecdfbf4f7b8a6da51c7348b3a4, user_id=576c840d1fc5419285063c4b44f97c13, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.875716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=025b9da00a9d414c8edb64502f5194f5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:36.877823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.879071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e227e93-5f50-4c09-9f2d-d141de8d2a70 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:36.898125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1060/2145] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:36 2022] PUT /identity/v3/projects/42a603ecdfbf4f7b8a6da51c7348b3a4/users/576c840d1fc5419285063c4b44f97c13/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:36.909733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:36.910018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:36.910283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:36.951349 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] MFA Rules not processed for user `576c840d1fc5419285063c4b44f97c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:36.952194 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:36.954621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025b9da00a9d414c8edb64502f5194f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.955423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025b9da00a9d414c8edb64502f5194f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.963686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025b9da00a9d414c8edb64502f5194f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.973935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025b9da00a9d414c8edb64502f5194f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:36.993628 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-e0e21de0-9309-481d-a34a-2af0b2eae0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025b9da00a9d414c8edb64502f5194f5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:37.002684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1086/2146] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:36 2022] DELETE /identity/v3/users/025b9da00a9d414c8edb64502f5194f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:37.006930 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.007214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.007561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.028526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:37.029924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.037497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1061/2147] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:37.040050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:37.042470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.044195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.111804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1087/2148] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:37.121704 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.122846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a033f0-9204-40e7-b2bb-de8b118343f0 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.123355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.127593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.128297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.128576 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.128844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.129493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.131499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.159783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1062/2149] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:37.164672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.188683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321efc93-8ca7-4578-92f9-eea7466ceaa9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.237730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1119a-ec2d-40b0-bdff-3ca86d5eb667 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.241851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.242511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.242817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.242931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.243104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.243429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.243715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.243979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.244652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.246598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.253353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.254922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.257548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:37.265564 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1088/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:37.272461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1063/2151] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:37.276097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.286542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4e832-2e1d-4d70-be60-71e25f793a69 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.291870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.292459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.292733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.293000 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.293643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.295425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.306038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1089/2152] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:37.311473 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.322859 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d8b7f-875b-43b1-a0a9-08930bf23700 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.328315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.328662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.328947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.329269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] PATH_INFO: `/v3/projects/b30ab21d287a47f99b9b6bfe4007dd7a/users/3ffab6bf64c4496fa4288081fedfeab7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.346328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30ab21d287a47f99b9b6bfe4007dd7a, user_id=3ffab6bf64c4496fa4288081fedfeab7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.349140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.364810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1064/2153] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:37 2022] PUT /identity/v3/projects/b30ab21d287a47f99b9b6bfe4007dd7a/users/3ffab6bf64c4496fa4288081fedfeab7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:37.369495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.379985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0e9d1-3af1-4d84-a918-66c5e414d336 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.440347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c03a-c220-40eb-b42c-8d0e97496fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.441057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c03a-c220-40eb-b42c-8d0e97496fed admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.441399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c03a-c220-40eb-b42c-8d0e97496fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.441733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c03a-c220-40eb-b42c-8d0e97496fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.442480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687c03a-c220-40eb-b42c-8d0e97496fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.444224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687c03a-c220-40eb-b42c-8d0e97496fed admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.446985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:37.456874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1090/2154] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:37.461366 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.472680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74349aa-7b5a-4362-b9e9-ad6db1743790 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.478500 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.479430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.479774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.480041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] PATH_INFO: `/v3/projects/b30ab21d287a47f99b9b6bfe4007dd7a/users/3ffab6bf64c4496fa4288081fedfeab7/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.482005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30ab21d287a47f99b9b6bfe4007dd7a, user_id=3ffab6bf64c4496fa4288081fedfeab7, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.484822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.496525 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1065/2155] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:37 2022] PUT /identity/v3/projects/b30ab21d287a47f99b9b6bfe4007dd7a/users/3ffab6bf64c4496fa4288081fedfeab7/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:37.506892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.507272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.507661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.537689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] MFA Rules not processed for user `3ffab6bf64c4496fa4288081fedfeab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:37.539200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.541738 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.543491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.618449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1091/2156] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:37.619445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72010d-d0f5-4eb9-8cfe-ae29096fcfcd admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.626709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.628360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.628360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.628360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] PATH_INFO: `/v3/projects/a0d7b23839f94e24a2e372b5361bcd17` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.629006 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d7b23839f94e24a2e372b5361bcd17)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.629891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.631112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.631506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.685573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d7b23839f94e24a2e372b5361bcd17', 'request_id': 'req-e4fbff5d-7217-4304-8b27-502c4d364638'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:37.692085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d7b23839f94e24a2e372b5361bcd17', 'request_id': 'req-e4fbff5d-7217-4304-8b27-502c4d364638'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:37.700825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d7b23839f94e24a2e372b5361bcd17', 'request_id': 'req-e4fbff5d-7217-4304-8b27-502c4d364638'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:37.705172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678074e-6f15-422e-8fc4-8cca4fc95867 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.712518 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] The token cache is being invalidate because project a0d7b23839f94e24a2e372b5361bcd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:37.712808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:37.713566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-e4fbff5d-7217-4304-8b27-502c4d364638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:37.715516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1066/2157] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:37 2022] DELETE /identity/v3/projects/a0d7b23839f94e24a2e372b5361bcd17 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:37.720197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d2a8-29e8-4d43-b8b0-e1f645cb6c04 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.720480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d2a8-29e8-4d43-b8b0-e1f645cb6c04 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.720751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d2a8-29e8-4d43-b8b0-e1f645cb6c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.740969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0000d2a8-29e8-4d43-b8b0-e1f645cb6c04 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:37.742239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0000d2a8-29e8-4d43-b8b0-e1f645cb6c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.757847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.758469 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.758774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.759043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.760819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.789065 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:37.809941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1067/2158] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:37.816538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:37.817932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb01db-4898-499a-8af1-601fb1ac6f6d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.818211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb01db-4898-499a-8af1-601fb1ac6f6d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.818482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb01db-4898-499a-8af1-601fb1ac6f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.828666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.830104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.839061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4beb01db-4898-499a-8af1-601fb1ac6f6d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:37.839981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1092/2159] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:37.840265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4beb01db-4898-499a-8af1-601fb1ac6f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:37.849514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1068/2160] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:37.854300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.865520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015def9-47e8-4d46-88d3-1c1663f4d1f8 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.878167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.878825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.879095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.879357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.880005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:37.880609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.881964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.899319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1093/2161] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:37.900530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb01db-4898-499a-8af1-601fb1ac6f6d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.910877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb01db-4898-499a-8af1-601fb1ac6f6d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.916273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:37.916944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:37.917219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:37.917487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:37.918124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:37.920088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:37.960035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1069/2162] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:37.961428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.972618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4875-f93f-44c2-90e7-ffbdd90f1ad0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:37.987300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:37.989279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.042805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.043451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.043741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.044002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.044645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.046596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.059068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95192043-e15b-4714-b063-12b04b5264d8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.064054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.064883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.065256 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.065524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] PATH_INFO: `/v3/users/576c840d1fc5419285063c4b44f97c13` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.066740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=576c840d1fc5419285063c4b44f97c13)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.069191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.078607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1094/2163] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:37 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:38.084313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.095002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb35f2c-dac4-4155-8a49-9b2bcd76958a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.100617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.101645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.101925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.102195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.102897 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.104525 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.120477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1095/2164] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:38.126803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.127796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576c840d1fc5419285063c4b44f97c13'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.128637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576c840d1fc5419285063c4b44f97c13'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.141851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd94034-9b7e-461d-98a4-bbb04a9a7d73 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.143746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576c840d1fc5419285063c4b44f97c13'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.149728 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.150756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.151221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.151688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.152100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576c840d1fc5419285063c4b44f97c13'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.152804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.153145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de1041d1-b1b7-4b71-97bd-22a0cdc4dad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576c840d1fc5419285063c4b44f97c13'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.155750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.171439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1096/2165] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:38.177195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.178997 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.182515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1070/2166] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:37 2022] DELETE /identity/v3/users/576c840d1fc5419285063c4b44f97c13 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:38.188225 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.188529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.188789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.193547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ca83b-ad8d-4405-8f77-0f8f6918b147 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.210314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:38.211731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.263282 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:38.281135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.282080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.282440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.282814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] PATH_INFO: `/v3/projects/ea096be3a3a64184be9866723b9aca24/users/be1ef33c91604e3693f589ef0c32599f/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.301802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea096be3a3a64184be9866723b9aca24, user_id=be1ef33c91604e3693f589ef0c32599f, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.304605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1071/2167] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:38.304761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.306293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.310275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.323958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1097/2168] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:38 2022] PUT /identity/v3/projects/ea096be3a3a64184be9866723b9aca24/users/be1ef33c91604e3693f589ef0c32599f/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:38.325082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.326851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.360839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:38.376962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf8ed4-b59f-4d0d-a8bc-5b120f9c750f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.394457 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015beff-844b-4b40-9f7e-44e01986ebbc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.398896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360708-6a4d-4b96-b41e-6f6a9ee156da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.399592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360708-6a4d-4b96-b41e-6f6a9ee156da service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.399873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360708-6a4d-4b96-b41e-6f6a9ee156da service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.400140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360708-6a4d-4b96-b41e-6f6a9ee156da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.428995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.429640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.429917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.430184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.431984 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.464421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360708-6a4d-4b96-b41e-6f6a9ee156da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.465846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360708-6a4d-4b96-b41e-6f6a9ee156da service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.475751 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1098/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:38.476925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.477201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.477466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.500498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.502424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.507723 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] MFA Rules not processed for user `be1ef33c91604e3693f589ef0c32599f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:38.509944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.513647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1072/2170] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:38.587936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1099/2171] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:38.599125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.600712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.655363 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:38.671978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6f922-70e1-47f1-acbe-09b2092e7a6c service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.676124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.676783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.677060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.677331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.687257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.688717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.699347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1073/2172] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:38.783260 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.784829 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:38.807098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fe754-7e15-41ed-9b24-6c21fd9f8fe9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:38.819739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:38.821372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:38.821856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:38.822297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] PATH_INFO: `/v3/projects/42a603ecdfbf4f7b8a6da51c7348b3a4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:38.823910 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a603ecdfbf4f7b8a6da51c7348b3a4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:38.826651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:38.882860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a603ecdfbf4f7b8a6da51c7348b3a4', 'request_id': 'req-87c4208d-1b72-4157-a0a7-ffcb923da57a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.889782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a603ecdfbf4f7b8a6da51c7348b3a4', 'request_id': 'req-87c4208d-1b72-4157-a0a7-ffcb923da57a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.899001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a603ecdfbf4f7b8a6da51c7348b3a4', 'request_id': 'req-87c4208d-1b72-4157-a0a7-ffcb923da57a'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.901250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:38.912670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] The token cache is being invalidate because project 42a603ecdfbf4f7b8a6da51c7348b3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:38.913161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.913729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:38.915953 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1100/2173] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:38 2022] DELETE /identity/v3/projects/42a603ecdfbf4f7b8a6da51c7348b3a4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:38.920259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:38.934115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7f1cb-d2ec-488b-9f0c-fc7f0afbb283 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:39.015741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:39.016600 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:39.017221 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:39.017662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] PATH_INFO: `/v3/users/3ffab6bf64c4496fa4288081fedfeab7` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:39.019164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffab6bf64c4496fa4288081fedfeab7)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:39.021264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:39.093752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffab6bf64c4496fa4288081fedfeab7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.094158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffab6bf64c4496fa4288081fedfeab7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.108041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffab6bf64c4496fa4288081fedfeab7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.115585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffab6bf64c4496fa4288081fedfeab7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.116611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3ef5db9e-7c7c-4ebc-9f73-bc19c912c1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffab6bf64c4496fa4288081fedfeab7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.137861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1074/2174] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:38 2022] DELETE /identity/v3/users/3ffab6bf64c4496fa4288081fedfeab7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:39.424989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:39.427904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:39.448867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4208d-1b72-4157-a0a7-ffcb923da57a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:39.531233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:39.532086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:39.532197 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:39.532431 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] PATH_INFO: `/v3/projects/b30ab21d287a47f99b9b6bfe4007dd7a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:39.533958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30ab21d287a47f99b9b6bfe4007dd7a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:39.536180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:39.594641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30ab21d287a47f99b9b6bfe4007dd7a', 'request_id': 'req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.602357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30ab21d287a47f99b9b6bfe4007dd7a', 'request_id': 'req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.612041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30ab21d287a47f99b9b6bfe4007dd7a', 'request_id': 'req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.624595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] The token cache is being invalidate because project b30ab21d287a47f99b9b6bfe4007dd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:39.624981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.625711 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a9ac51b-0645-470e-bb9f-5c6d4b6f6232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:39.627490 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1101/2175] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:39 2022] DELETE /identity/v3/projects/b30ab21d287a47f99b9b6bfe4007dd7a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:39.632646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b8f9-354f-4af2-bf55-1fa5aa706b58 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:39.632925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b8f9-354f-4af2-bf55-1fa5aa706b58 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:39.633412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8b8f9-354f-4af2-bf55-1fa5aa706b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:39.654878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7ea8b8f9-354f-4af2-bf55-1fa5aa706b58 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:39.656179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7ea8b8f9-354f-4af2-bf55-1fa5aa706b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:39.722773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1075/2176] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:39.731056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eadc3-3b7a-4e96-bb0b-a139d44fa02f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:39.731351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eadc3-3b7a-4e96-bb0b-a139d44fa02f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:39.731643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eadc3-3b7a-4e96-bb0b-a139d44fa02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:39.754489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-cf7eadc3-3b7a-4e96-bb0b-a139d44fa02f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:39.755703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-cf7eadc3-3b7a-4e96-bb0b-a139d44fa02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:39.764395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1102/2177] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:39.769185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b8f9-354f-4af2-bf55-1fa5aa706b58 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:39.779861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8b8f9-354f-4af2-bf55-1fa5aa706b58 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:39.784825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:39.785455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:39.785720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:39.785983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:39.786803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:39.787385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:39.789073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:39.790989 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:39.805988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1076/2178] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:39.811139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eadc3-3b7a-4e96-bb0b-a139d44fa02f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:39.822417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eadc3-3b7a-4e96-bb0b-a139d44fa02f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:39.829310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:39.830064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:39.830383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:39.830682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:39.831417 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:39.833507 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:39.866732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1103/2179] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:39 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:39.871328 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:39.884130 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97318af-54fa-42bb-a8c6-da969484110b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:39.952482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:39.953218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:39.953494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:39.953765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:39.954445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:39.956457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:39.990139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1077/2180] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:39 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:39.991334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.007745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144759e-eaec-4faa-b306-29199d842ddb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.013175 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.013790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.014081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.014346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.015037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.016644 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.030172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1104/2181] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:40.031912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.042927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219c6d1-b438-4728-ab30-65c73136f3a9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.047987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e771ee6-53b7-4577-a156-7667f0bdb13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.048593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771ee6-53b7-4577-a156-7667f0bdb13a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.048868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771ee6-53b7-4577-a156-7667f0bdb13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.049133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e771ee6-53b7-4577-a156-7667f0bdb13a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.049822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e771ee6-53b7-4577-a156-7667f0bdb13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.051486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e771ee6-53b7-4577-a156-7667f0bdb13a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.062541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1078/2182] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:40.066918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.079529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11973-ae49-4599-8f69-b6f4af63fb59 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.085045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.085773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.086130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.086468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] PATH_INFO: `/v3/projects/5eba914c75ec48d9b8c229b2ca86ab52/users/3791be782af446059b1b06f21aa4d202/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.103093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eba914c75ec48d9b8c229b2ca86ab52, user_id=3791be782af446059b1b06f21aa4d202, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.105738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.125874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1105/2183] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:40 2022] PUT /identity/v3/projects/5eba914c75ec48d9b8c229b2ca86ab52/users/3791be782af446059b1b06f21aa4d202/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:40.138703 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a920a0-8b94-4c97-931c-739c13f6c566 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.139020 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a920a0-8b94-4c97-931c-739c13f6c566 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.139321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a920a0-8b94-4c97-931c-739c13f6c566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.170214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d5a920a0-8b94-4c97-931c-739c13f6c566 None None] MFA Rules not processed for user `3791be782af446059b1b06f21aa4d202`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:40.171519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5a920a0-8b94-4c97-931c-739c13f6c566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:40.243317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1079/2184] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:40.249005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.271462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:40.327394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e80102-4ea9-4cf4-8d73-57521ab1d400 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.333867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.334313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.334649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.334959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.336142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.338341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.373762 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1106/2185] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:40 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:40.378860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a920a0-8b94-4c97-931c-739c13f6c566 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.395261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a920a0-8b94-4c97-931c-739c13f6c566 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.470265 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.470927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.471230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.471537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.472404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.474364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.485103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:40.507696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1080/2186] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:40 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:40.509292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.521899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d079b2-0e40-4ac5-94ce-935422a14bbf admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.528212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.528838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.530342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.530342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.531053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.533198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.550074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1107/2187] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:40.551578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.563524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9052c4-2d86-47f8-965e-b0d7112ebe06 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.569037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.569726 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.570064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.570380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] PATH_INFO: `/v3/projects/2e0229d9789e473f826429c842b4fa2b/users/4c9390ff91d04159a3baa0e54867a6cd/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.592487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0229d9789e473f826429c842b4fa2b, user_id=4c9390ff91d04159a3baa0e54867a6cd, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.595917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.616263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1081/2188] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:40 2022] PUT /identity/v3/projects/2e0229d9789e473f826429c842b4fa2b/users/4c9390ff91d04159a3baa0e54867a6cd/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:40.620238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.631148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2e9b0-cb4b-439c-98e8-c8b60c923c5a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.708937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ecb99-32ed-44ff-8939-9a2c7907f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.709727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ecb99-32ed-44ff-8939-9a2c7907f77a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.710097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ecb99-32ed-44ff-8939-9a2c7907f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.710475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ecb99-32ed-44ff-8939-9a2c7907f77a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.711265 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ecb99-32ed-44ff-8939-9a2c7907f77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.713403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ecb99-32ed-44ff-8939-9a2c7907f77a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.730797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1108/2189] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:40.732213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.745258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67498038-c8e8-4d14-8714-b803ca24d855 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:40.754250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:40.755378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.755656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.756069 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] PATH_INFO: `/v3/projects/2e0229d9789e473f826429c842b4fa2b/users/4c9390ff91d04159a3baa0e54867a6cd/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.758390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0229d9789e473f826429c842b4fa2b, user_id=4c9390ff91d04159a3baa0e54867a6cd, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:40.761617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:40.776846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1082/2190] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:40 2022] PUT /identity/v3/projects/2e0229d9789e473f826429c842b4fa2b/users/4c9390ff91d04159a3baa0e54867a6cd/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:40.789342 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:40.789855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:40.790182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:40.826149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] MFA Rules not processed for user `4c9390ff91d04159a3baa0e54867a6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:40.827451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:40.927960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1109/2191] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:40.939921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:40.941950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:41.031381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c850d14-c7b4-4475-a646-7b1d94cda8c0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:41.035162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:41.035883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:41.036253 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:41.036593 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:41.095216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:41.096688 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:41.106197 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1083/2192] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:42.047895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:42.050539 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:42.069221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:42.147520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c6898-0948-442f-b92f-53e3f288c6c1 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:42.147642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:42.149317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:42.153288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:42.154042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:42.154379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:42.154757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:42.157184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:42.170346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:42.172697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:42.184944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1110/2193] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:42.244997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0c634-d90a-4356-945b-8694e58955b8 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:42.249601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:42.250267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:42.250536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:42.250836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] PATH_INFO: `/v3/users/62e872a76ae44efb845dc3a62b783492` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:42.252007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e872a76ae44efb845dc3a62b783492)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:42.254170 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:42.268512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:42.314880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e872a76ae44efb845dc3a62b783492'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.315548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e872a76ae44efb845dc3a62b783492'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.328337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e872a76ae44efb845dc3a62b783492'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.335495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e872a76ae44efb845dc3a62b783492'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.336231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-52d7611c-ffa1-4b7a-8a14-a013ea328ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e872a76ae44efb845dc3a62b783492'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.350160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1084/2194] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:42 2022] DELETE /identity/v3/users/62e872a76ae44efb845dc3a62b783492 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:42.551760 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:42.565355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c109df-c7a3-40a9-9943-6998a5bd8831 service placement] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:42.636254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:42.636904 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:42.637337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:42.637586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] PATH_INFO: `/v3/projects/4dcc4bb0f4b8456a9126207845b0dc7a` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:42.638867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dcc4bb0f4b8456a9126207845b0dc7a)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:42.646145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:42.700928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dcc4bb0f4b8456a9126207845b0dc7a', 'request_id': 'req-a6531ae0-c49a-4973-9629-d6908224a84d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.707530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dcc4bb0f4b8456a9126207845b0dc7a', 'request_id': 'req-a6531ae0-c49a-4973-9629-d6908224a84d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.716755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dcc4bb0f4b8456a9126207845b0dc7a', 'request_id': 'req-a6531ae0-c49a-4973-9629-d6908224a84d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.728841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] The token cache is being invalidate because project 4dcc4bb0f4b8456a9126207845b0dc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:42.729129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.729806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a6531ae0-c49a-4973-9629-d6908224a84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:42.731399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1111/2195] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:42 2022] DELETE /identity/v3/projects/4dcc4bb0f4b8456a9126207845b0dc7a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:42.736699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b086-b9ac-48bc-b523-7134a5cd8b7e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:42.736979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b086-b9ac-48bc-b523-7134a5cd8b7e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:42.737246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b086-b9ac-48bc-b523-7134a5cd8b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:42.762311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b4b8b086-b9ac-48bc-b523-7134a5cd8b7e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:42.763657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b4b8b086-b9ac-48bc-b523-7134a5cd8b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:42.828121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1085/2196] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:42.836048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f48fa-10a3-4561-a029-7ca88f9835f4 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:42.836464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f48fa-10a3-4561-a029-7ca88f9835f4 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:42.836757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f48fa-10a3-4561-a029-7ca88f9835f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:42.858537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-0b7f48fa-10a3-4561-a029-7ca88f9835f4 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:42.859800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0b7f48fa-10a3-4561-a029-7ca88f9835f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:42.868771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1112/2197] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:42.873432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8b086-b9ac-48bc-b523-7134a5cd8b7e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:42.883987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8b086-b9ac-48bc-b523-7134a5cd8b7e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:42.889235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:42.889846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:42.890126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:42.890383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:42.891075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:42.891365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:42.893031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:42.904889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1086/2198] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:42.910005 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f48fa-10a3-4561-a029-7ca88f9835f4 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:42.921235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f48fa-10a3-4561-a029-7ca88f9835f4 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:42.928130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:42.928778 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:42.929055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:42.929321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:42.929966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:42.931917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:42.963406 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1113/2199] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:42 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:42.969619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:42.984944 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9d995-6d95-4922-a885-16523b6fcb76 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.045928 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.046540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.046818 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.047087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.047733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.049694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.073204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1087/2200] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:42 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:43.077568 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.083663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:43.090388 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0599-78ba-4134-93dc-f13eb2f44ff5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.096433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.097169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.097556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.097902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.098707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.100433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.111485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1114/2201] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:43.115818 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.122512 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:43.126781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962c74-ed8c-468b-82d6-2df7587473d0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.133212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dbbf7-4c28-4291-aaac-e8c5ffaef0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.134217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dbbf7-4c28-4291-aaac-e8c5ffaef0fe admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.134537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dbbf7-4c28-4291-aaac-e8c5ffaef0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.134846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dbbf7-4c28-4291-aaac-e8c5ffaef0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.135544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dbbf7-4c28-4291-aaac-e8c5ffaef0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.137809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dbbf7-4c28-4291-aaac-e8c5ffaef0fe admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.153715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1088/2202] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:43.155777 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.167492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755430f2-81cb-4a9f-85c2-0080fa72f2c7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.172768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.174116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.174673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.175014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] PATH_INFO: `/v3/projects/65ae1013289d4dddad9d056fc490e15e/users/712fb11e9d47421c86a2fd8a99ee953b/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.191985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ae1013289d4dddad9d056fc490e15e, user_id=712fb11e9d47421c86a2fd8a99ee953b, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.194721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.209355 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1115/2203] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:43 2022] PUT /identity/v3/projects/65ae1013289d4dddad9d056fc490e15e/users/712fb11e9d47421c86a2fd8a99ee953b/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:43.220773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712292-c3f0-4245-af6f-3155f647bd1f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.221145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712292-c3f0-4245-af6f-3155f647bd1f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.221509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712292-c3f0-4245-af6f-3155f647bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.258092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-35712292-c3f0-4245-af6f-3155f647bd1f None None] MFA Rules not processed for user `712fb11e9d47421c86a2fd8a99ee953b`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:43.259486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-35712292-c3f0-4245-af6f-3155f647bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:43.325555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1089/2204] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:43.330625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.399010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db602dc-ba77-4f20-83f3-61afd056417f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.403750 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.404367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.404653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.404901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.405661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.407824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.440567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1116/2205] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:43 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:43.441707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35712292-c3f0-4245-af6f-3155f647bd1f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.453372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35712292-c3f0-4245-af6f-3155f647bd1f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.519970 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.520588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.520867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.521135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.521795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.523783 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.547751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1090/2206] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:43 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:43.553141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.564440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cbf84-efba-4856-8bff-cfe59e4399c7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.569532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.570196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.570468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.570949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.571597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.573258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.584700 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1117/2207] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:43.589112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.599959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ffe1f-62c0-4c69-9f3d-23f9d65eca1d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.605005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.605666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.605943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.606213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] PATH_INFO: `/v3/projects/613e3ec1cc264e8a89614a2193e0a94a/users/c180fe773d744c498794671a10a1f9f4/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.621340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613e3ec1cc264e8a89614a2193e0a94a, user_id=c180fe773d744c498794671a10a1f9f4, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.624054 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.639909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1091/2208] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:43 2022] PUT /identity/v3/projects/613e3ec1cc264e8a89614a2193e0a94a/users/c180fe773d744c498794671a10a1f9f4/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:43.644303 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.655223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd05e3-638d-45a3-82b6-3e3001d85b55 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.713756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.714365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.714669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.714937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.715580 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.717177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.727397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1118/2209] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:43.732541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.747617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97845abc-4523-4dda-8d2c-2ba9817b9e33 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.754091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81920200-c314-4052-91fa-396537dff6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.754923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920200-c314-4052-91fa-396537dff6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.755268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920200-c314-4052-91fa-396537dff6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.755691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81920200-c314-4052-91fa-396537dff6b3 admin admin] PATH_INFO: `/v3/projects/613e3ec1cc264e8a89614a2193e0a94a/users/c180fe773d744c498794671a10a1f9f4/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.758365 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920200-c314-4052-91fa-396537dff6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613e3ec1cc264e8a89614a2193e0a94a, user_id=c180fe773d744c498794671a10a1f9f4, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.762729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81920200-c314-4052-91fa-396537dff6b3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.764480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.766365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:43.772747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1092/2210] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:43 2022] PUT /identity/v3/projects/613e3ec1cc264e8a89614a2193e0a94a/users/c180fe773d744c498794671a10a1f9f4/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:43.779420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a2f9d-02da-42c7-83b9-dfb650fed09a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:43.785331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.785612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.785906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.813634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:43.814805 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] MFA Rules not processed for user `c180fe773d744c498794671a10a1f9f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:43.816134 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:43.839111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:43.839812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.840094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.840423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] PATH_INFO: `/v3/users/3791be782af446059b1b06f21aa4d202` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.840845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:43.841583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3791be782af446059b1b06f21aa4d202)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:43.843547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:43.886951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1093/2211] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:43.891721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3791be782af446059b1b06f21aa4d202'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:43.892380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3791be782af446059b1b06f21aa4d202'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:43.898152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:43.899699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:43.900743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3791be782af446059b1b06f21aa4d202'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:43.910836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3791be782af446059b1b06f21aa4d202'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:43.925270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-8a1b4c84-6df3-4a44-b0cb-a1c6d628d705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3791be782af446059b1b06f21aa4d202'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:43.932348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1119/2212] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:43 2022] DELETE /identity/v3/users/3791be782af446059b1b06f21aa4d202 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:43.936779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:43.937148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:43.937329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:43.956613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:43.957813 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:43.963879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae58e9-9bb9-4c75-a0c7-9403f5ba4893 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.017743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.018361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.018669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.018939 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.020729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.028679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1120/2213] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:44.038957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:44.040319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.083469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.085028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.094847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1094/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:43 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:44.097567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675f70a-3555-4e8c-abdc-ac18f1f49ab9 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.101249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561c3f7-434d-4975-8825-4eccac67241c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.102056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c3f7-434d-4975-8825-4eccac67241c service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.102440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c3f7-434d-4975-8825-4eccac67241c service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.102782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561c3f7-434d-4975-8825-4eccac67241c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.113690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c3f7-434d-4975-8825-4eccac67241c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.115164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561c3f7-434d-4975-8825-4eccac67241c service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.123921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:44.129687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1121/2215] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:44.244545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:44.246027 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.259359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09933e8-1d9d-4dac-a56a-ae5e7c8ede78 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.264182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.264896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.265165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.265428 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] PATH_INFO: `/v3/users/712fb11e9d47421c86a2fd8a99ee953b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.266563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712fb11e9d47421c86a2fd8a99ee953b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.268849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.299105 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:44.327502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712fb11e9d47421c86a2fd8a99ee953b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.328232 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712fb11e9d47421c86a2fd8a99ee953b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.341515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712fb11e9d47421c86a2fd8a99ee953b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.349068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712fb11e9d47421c86a2fd8a99ee953b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.349718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712fb11e9d47421c86a2fd8a99ee953b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.363647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1095/2216] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:44 2022] DELETE /identity/v3/users/712fb11e9d47421c86a2fd8a99ee953b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:44.368318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.368601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.368870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.388113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:44.389316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.416382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:44.419060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.473710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1122/2217] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:44.478087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:44.479549 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.492658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a3c18-d226-45a9-9a87-414c24b02f18 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.497371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.497991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.498266 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.498535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] PATH_INFO: `/v3/users/be1ef33c91604e3693f589ef0c32599f` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.499702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1ef33c91604e3693f589ef0c32599f)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.501666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.504190 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294da9e8-f5da-445a-97b0-0cf0b2a0a268 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.509515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.510150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.510421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.510724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] PATH_INFO: `/v3/projects/5eba914c75ec48d9b8c229b2ca86ab52` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.511868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eba914c75ec48d9b8c229b2ca86ab52)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.513773 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.555567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1ef33c91604e3693f589ef0c32599f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.556228 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1ef33c91604e3693f589ef0c32599f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.562294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eba914c75ec48d9b8c229b2ca86ab52', 'request_id': 'req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.563566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1ef33c91604e3693f589ef0c32599f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.568292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eba914c75ec48d9b8c229b2ca86ab52', 'request_id': 'req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.571798 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1ef33c91604e3693f589ef0c32599f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.575816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eba914c75ec48d9b8c229b2ca86ab52', 'request_id': 'req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.584764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1ef33c91604e3693f589ef0c32599f'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.588268 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] The token cache is being invalidate because project 5eba914c75ec48d9b8c229b2ca86ab52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:44.588563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.589235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.591122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1123/2219] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:44 2022] DELETE /identity/v3/users/be1ef33c91604e3693f589ef0c32599f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:44.591251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1096/2219] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:44 2022] DELETE /identity/v3/projects/5eba914c75ec48d9b8c229b2ca86ab52 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:44.592045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:44.593462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.594967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:44.596391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.628252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:44.655023 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668c85d-d08e-4c3b-9cc3-5a48f98d5447 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.658738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d6e95-7edd-43d3-a1b7-149d4688f665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.659419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6e95-7edd-43d3-a1b7-149d4688f665 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.659693 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6e95-7edd-43d3-a1b7-149d4688f665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.659958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d6e95-7edd-43d3-a1b7-149d4688f665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.661879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bf5d6e95-7edd-43d3-a1b7-149d4688f665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.662501 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a29e9a-33d0-4781-bfe4-75e5c9593ad7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.695146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:44.724660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.725294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.725560 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.725819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] PATH_INFO: `/v3/users/4c9390ff91d04159a3baa0e54867a6cd` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.727031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9390ff91d04159a3baa0e54867a6cd)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.728959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.735415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6e95-7edd-43d3-a1b7-149d4688f665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.736846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d6e95-7edd-43d3-a1b7-149d4688f665 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.747057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1124/2220] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:44.748194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.748538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.748802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.769942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:44.771195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.779935 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1125/2221] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:44.784787 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9390ff91d04159a3baa0e54867a6cd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.785457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9390ff91d04159a3baa0e54867a6cd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.790919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:44.792433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.803124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9390ff91d04159a3baa0e54867a6cd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.805949 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd40f6-215a-4e75-b501-ce0283e97b3f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:44.811562 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9390ff91d04159a3baa0e54867a6cd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.812295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:44.812430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9390ff91d04159a3baa0e54867a6cd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:44.812924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:44.813221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:44.813479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:44.816311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:44.827154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1097/2222] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:44 2022] DELETE /identity/v3/users/4c9390ff91d04159a3baa0e54867a6cd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:44.832983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:44.834650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:44.847042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1126/2223] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:45.209985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.211371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.282573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:45.288740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82c7b-069c-4583-82c8-3bbf90703143 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.295706 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.296430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.296713 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.296985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] PATH_INFO: `/v3/projects/65ae1013289d4dddad9d056fc490e15e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.298432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ae1013289d4dddad9d056fc490e15e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.300745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.349881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ae1013289d4dddad9d056fc490e15e', 'request_id': 'req-4fed3fdb-a649-4247-8ebe-32c4778cbc52'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.358752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ae1013289d4dddad9d056fc490e15e', 'request_id': 'req-4fed3fdb-a649-4247-8ebe-32c4778cbc52'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.369305 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ae1013289d4dddad9d056fc490e15e', 'request_id': 'req-4fed3fdb-a649-4247-8ebe-32c4778cbc52'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.380642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.382091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.388292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] The token cache is being invalidate because project 65ae1013289d4dddad9d056fc490e15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:45.388920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.389809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.392144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1098/2224] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:45 2022] DELETE /identity/v3/projects/65ae1013289d4dddad9d056fc490e15e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:45.393195 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.395010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.395939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187bc00-2125-4ef4-b04b-8246aa47e230 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.458727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.459361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.459642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.459894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] PATH_INFO: `/v3/projects/ea096be3a3a64184be9866723b9aca24` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.461002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea096be3a3a64184be9866723b9aca24)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.463016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.468896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed3fdb-a649-4247-8ebe-32c4778cbc52 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.473961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.474657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.474929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.475191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] PATH_INFO: `/v3/projects/2e0229d9789e473f826429c842b4fa2b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.476422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0229d9789e473f826429c842b4fa2b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.478286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.510696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea096be3a3a64184be9866723b9aca24', 'request_id': 'req-710bd1ff-219c-47a2-aa51-4aaead4d5c47'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.517678 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea096be3a3a64184be9866723b9aca24', 'request_id': 'req-710bd1ff-219c-47a2-aa51-4aaead4d5c47'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.526089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea096be3a3a64184be9866723b9aca24', 'request_id': 'req-710bd1ff-219c-47a2-aa51-4aaead4d5c47'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.527610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0229d9789e473f826429c842b4fa2b', 'request_id': 'req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.533806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0229d9789e473f826429c842b4fa2b', 'request_id': 'req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.536587 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] The token cache is being invalidate because project ea096be3a3a64184be9866723b9aca24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:45.537366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.538058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.539627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1127/2225] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:45 2022] DELETE /identity/v3/projects/ea096be3a3a64184be9866723b9aca24 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:45.540579 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.541914 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.545789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0229d9789e473f826429c842b4fa2b', 'request_id': 'req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.557686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] The token cache is being invalidate because project 2e0229d9789e473f826429c842b4fa2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:45.557960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.558614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1460cbb1-cfbb-4cbc-8b0c-4ff96cd136b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.560140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1099/2226] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:45 2022] DELETE /identity/v3/projects/2e0229d9789e473f826429c842b4fa2b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:45.561306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e58c-6ff1-4f04-92db-303d8bd9c831 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.561578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e58c-6ff1-4f04-92db-303d8bd9c831 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.561839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e58c-6ff1-4f04-92db-303d8bd9c831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.579450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:45.581180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5588e58c-6ff1-4f04-92db-303d8bd9c831 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:45.582531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5588e58c-6ff1-4f04-92db-303d8bd9c831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.592920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:45.611674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bd1ff-219c-47a2-aa51-4aaead4d5c47 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.644238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1100/2227] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:45.645491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a686a-97b4-4b53-8e06-7607c2245986 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.645769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a686a-97b4-4b53-8e06-7607c2245986 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.646037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a686a-97b4-4b53-8e06-7607c2245986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.665765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-031a686a-97b4-4b53-8e06-7607c2245986 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:45.666996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-031a686a-97b4-4b53-8e06-7607c2245986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.671253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.671895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.672169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.672441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] PATH_INFO: `/v3/users/c180fe773d744c498794671a10a1f9f4` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.673590 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c180fe773d744c498794671a10a1f9f4)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.675598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1101/2228] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:45.675726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.677320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a14a5-1335-462f-bf64-bcb6f7e3b5ce None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.677596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a14a5-1335-462f-bf64-bcb6f7e3b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.677863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a14a5-1335-462f-bf64-bcb6f7e3b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.697797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a72a14a5-1335-462f-bf64-bcb6f7e3b5ce None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:45.699027 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a72a14a5-1335-462f-bf64-bcb6f7e3b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.707415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1102/2229] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:45.712604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abbcb6-6bd2-4ed3-b0b3-e2b37fcbaa87 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.712604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abbcb6-6bd2-4ed3-b0b3-e2b37fcbaa87 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.712604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abbcb6-6bd2-4ed3-b0b3-e2b37fcbaa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.732850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-00abbcb6-6bd2-4ed3-b0b3-e2b37fcbaa87 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:45.734090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-00abbcb6-6bd2-4ed3-b0b3-e2b37fcbaa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.738049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c180fe773d744c498794671a10a1f9f4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.738755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c180fe773d744c498794671a10a1f9f4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.742206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1103/2230] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:45.743158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abbcb6-6bd2-4ed3-b0b3-e2b37fcbaa87 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.746686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c180fe773d744c498794671a10a1f9f4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.753090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abbcb6-6bd2-4ed3-b0b3-e2b37fcbaa87 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.756769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c180fe773d744c498794671a10a1f9f4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.758598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.759209 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.759480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.759742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.760394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:45.760693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.762293 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.769040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c180fe773d744c498794671a10a1f9f4'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:45.774344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1104/2231] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:45.775233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1128/2232] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:45 2022] DELETE /identity/v3/users/c180fe773d744c498794671a10a1f9f4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:45.778594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.778701 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.780074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.780188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:45.793097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227e00-ef5a-4a07-96c5-84c65a3884c9 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.862070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579695ba-6aab-4ad7-ace5-85637463db86 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.866001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.866977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.867247 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.867537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.868440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:45.868562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.868702 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.869600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.869973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.870152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.870359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.871846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.873364 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.879117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:45.885315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1105/2233] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:45.889630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.901358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b2432-9bf6-4d47-acc8-ea57cda00da3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:45.907033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:45.907798 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:45.908166 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:45.908927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:45.912809 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1129/2234] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:45.912960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:45.912960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:45.913936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:45.947075 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1106/2235] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:45.958233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.009196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2ba5a-0304-4c78-94c9-a3820afc83c2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.033258 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:46.040807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc641841-c4ea-48ac-be67-b4faf2829b0d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.047478 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.048106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.048526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.048794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.049444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.051427 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.081590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1107/2236] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:46.086921 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.088445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.088788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.089433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.089807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.090146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.090970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.092989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.108097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499b240-73aa-4ea6-9910-642b202ef4dc admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.116972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1130/2237] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:45 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:06:46.118386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.121244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.121908 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.122183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.122449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] PATH_INFO: `/v3/projects/613e3ec1cc264e8a89614a2193e0a94a` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.123623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613e3ec1cc264e8a89614a2193e0a94a)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.125569 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.129948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85fb36-3e61-4f38-bd91-e41e748d4ff5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.135357 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.136043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.136383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.136769 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.137511 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.139250 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.149550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1131/2238] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:46.150477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.162334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6291ab-1055-4a31-a689-b7dfad4fe4b0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.175141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613e3ec1cc264e8a89614a2193e0a94a', 'request_id': 'req-684c9b9b-bcb8-4162-a4eb-df1321475962'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:46.180850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613e3ec1cc264e8a89614a2193e0a94a', 'request_id': 'req-684c9b9b-bcb8-4162-a4eb-df1321475962'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:46.189332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613e3ec1cc264e8a89614a2193e0a94a', 'request_id': 'req-684c9b9b-bcb8-4162-a4eb-df1321475962'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:46.201563 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] The token cache is being invalidate because project 613e3ec1cc264e8a89614a2193e0a94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:46.201845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:46.202524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:46.204212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1108/2239] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:46 2022] DELETE /identity/v3/projects/613e3ec1cc264e8a89614a2193e0a94a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:46.205050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.210196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.222365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849f7ea-dcd9-4c76-b523-43bdeca375d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.223028 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f7ea-dcd9-4c76-b523-43bdeca375d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.223304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f7ea-dcd9-4c76-b523-43bdeca375d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.223574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849f7ea-dcd9-4c76-b523-43bdeca375d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.224215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849f7ea-dcd9-4c76-b523-43bdeca375d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.225815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849f7ea-dcd9-4c76-b523-43bdeca375d3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.237624 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1132/2240] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:46.239205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.239500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.239767 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.257229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:46.264043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:46.265839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.274351 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1133/2241] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:46.275308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.280567 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.288990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9b9b-bcb8-4162-a4eb-df1321475962 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.292785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c956-d958-4217-97bd-256ef6bdae84 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.293754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f50bf-2c69-43a2-bda8-648f8175922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.294364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f50bf-2c69-43a2-bda8-648f8175922d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.294708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f50bf-2c69-43a2-bda8-648f8175922d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.294947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f50bf-2c69-43a2-bda8-648f8175922d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.295601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f50bf-2c69-43a2-bda8-648f8175922d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.297219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f50bf-2c69-43a2-bda8-648f8175922d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.298141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.298773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.299043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.299310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.299944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.301558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.307774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1109/2242] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:46.309148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346487-0e1d-44df-9fd4-75cc6e0ab4e8 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.309429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346487-0e1d-44df-9fd4-75cc6e0ab4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.309685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346487-0e1d-44df-9fd4-75cc6e0ab4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.315135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1134/2243] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:46.315135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.324662 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33047ca-d2f5-495b-8064-45ced003bb5e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.329509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.329985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-41346487-0e1d-44df-9fd4-75cc6e0ab4e8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:46.330107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.330341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.330634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] PATH_INFO: `/v3/projects/5dc5a3f0d4fa48cf9212a7ecb4bc55ff/users/84cc4d1250a047f2a994beab54d9f3e8/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.331204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-41346487-0e1d-44df-9fd4-75cc6e0ab4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.339641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1110/2244] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:46.340433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346487-0e1d-44df-9fd4-75cc6e0ab4e8 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.348979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc5a3f0d4fa48cf9212a7ecb4bc55ff, user_id=84cc4d1250a047f2a994beab54d9f3e8, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.350176 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346487-0e1d-44df-9fd4-75cc6e0ab4e8 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.351667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.354918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936affd0-a37b-4836-9930-1f8b80a701d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.355567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936affd0-a37b-4836-9930-1f8b80a701d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.355839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936affd0-a37b-4836-9930-1f8b80a701d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.356106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936affd0-a37b-4836-9930-1f8b80a701d8 admin admin] PATH_INFO: `/v3/projects/bf27862168e747f49872ab0ba09342e2/users/9afb1bb49fb9410b856c8bdcd168a5c9/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.366086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1135/2245] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:46 2022] PUT /identity/v3/projects/5dc5a3f0d4fa48cf9212a7ecb4bc55ff/users/84cc4d1250a047f2a994beab54d9f3e8/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:46.367226 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.383045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936affd0-a37b-4836-9930-1f8b80a701d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf27862168e747f49872ab0ba09342e2, user_id=9afb1bb49fb9410b856c8bdcd168a5c9, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.386541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936affd0-a37b-4836-9930-1f8b80a701d8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.401709 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1111/2246] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:46 2022] PUT /identity/v3/projects/bf27862168e747f49872ab0ba09342e2/users/9afb1bb49fb9410b856c8bdcd168a5c9/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:46.402765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755c148-83e8-415a-b8d6-64f65802bf68 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.403043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755c148-83e8-415a-b8d6-64f65802bf68 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.403388 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755c148-83e8-415a-b8d6-64f65802bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.431353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c755c148-83e8-415a-b8d6-64f65802bf68 None None] MFA Rules not processed for user `84cc4d1250a047f2a994beab54d9f3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:46.432639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c755c148-83e8-415a-b8d6-64f65802bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.442925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c6e4c-0a50-4482-953f-639658e05309 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.454300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:46.501846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1112/2247] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:46.502929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.503547 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.503824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.504089 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.504740 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:46.505123 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.506628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.506812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.506922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.507161 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.520774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1136/2248] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:46.521690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.523589 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.541774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] MFA Rules not processed for user `9afb1bb49fb9410b856c8bdcd168a5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:46.543138 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.580617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286a802-8161-4642-b215-7c65356219cd admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.584645 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.585249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.585499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.585745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.594832 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.596345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.605492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1137/2249] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:46.606395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.607449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1113/2250] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:46.617477 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efeaca-45b6-4590-a4b5-114d20df40ec service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.618487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.620577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:46.622349 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.623040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.623373 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.623696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.624385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.626381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.632674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:46.633064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcb043-992c-44d5-9df1-324fce774a7d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.636950 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.637557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.637827 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.638095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.648375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.650049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.662982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1138/2251] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:46 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:46.664674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.669769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1114/2252] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:46.732241 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6578e4-2e77-4e60-a357-53533bca597b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.736996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.737610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.737883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.738151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.738843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.740779 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.765946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1139/2253] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:46 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:46.770373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.781530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e34384-50c9-497a-a884-2dad4ea828bd service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.787616 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.788384 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.788660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.788992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.789774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.791484 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.805739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1115/2254] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:46.810174 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.820879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0447-8382-4e98-b502-a5750ac93873 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.826737 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47a93-f72f-4820-8111-1140a80caf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.827356 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47a93-f72f-4820-8111-1140a80caf30 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.827627 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47a93-f72f-4820-8111-1140a80caf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.827922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47a93-f72f-4820-8111-1140a80caf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.828572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb47a93-f72f-4820-8111-1140a80caf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.830179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb47a93-f72f-4820-8111-1140a80caf30 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.841596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1140/2255] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:46.846317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:46.857458 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac82384-ee95-4541-9816-d5e24970a85e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:46.862762 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:46.863559 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.863862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.864130 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] PATH_INFO: `/v3/projects/f40cf5f8252142f9825e0c94e849971c/users/7b8e27f025c841d6bd5f3d8fe50935a8/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.881383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40cf5f8252142f9825e0c94e849971c, user_id=7b8e27f025c841d6bd5f3d8fe50935a8, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:46.884123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:46.909094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1116/2256] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:46 2022] PUT /identity/v3/projects/f40cf5f8252142f9825e0c94e849971c/users/7b8e27f025c841d6bd5f3d8fe50935a8/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:46.914649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26d44-9af5-40c8-89dc-3dd458ec456b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:46.915206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26d44-9af5-40c8-89dc-3dd458ec456b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:46.915206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26d44-9af5-40c8-89dc-3dd458ec456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:46.939654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b2d26d44-9af5-40c8-89dc-3dd458ec456b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:46.940921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b2d26d44-9af5-40c8-89dc-3dd458ec456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:47.040381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1141/2257] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:47.050747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:47.052920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:47.113033 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155c19c-c0be-46e1-8446-7e6db4eb5903 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:47.116784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:47.117510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:47.117782 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:47.118049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:47.127269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:47.128715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:47.138324 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1117/2258] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:47.791739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89c26b-1212-4919-8579-faee2ea32d6c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:47.792420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89c26b-1212-4919-8579-faee2ea32d6c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:47.792420 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89c26b-1212-4919-8579-faee2ea32d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:47.822224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3c89c26b-1212-4919-8579-faee2ea32d6c None None] MFA Rules not processed for user `7b8e27f025c841d6bd5f3d8fe50935a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:47.823492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3c89c26b-1212-4919-8579-faee2ea32d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:47.892639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:47.903581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1142/2259] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:47.908333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:47.918731 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f58b1-36f8-42bd-bc75-c840351c3cd1 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:47.923857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:47.924457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:47.924729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:47.924966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:47.925670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:47.927616 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:47.932319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:47.963318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1118/2260] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:47 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:47.965085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89c26b-1212-4919-8579-faee2ea32d6c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:47.989066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89c26b-1212-4919-8579-faee2ea32d6c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:48.057994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:48.058647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:48.058923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:48.059202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:48.060117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:48.062527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:48.090697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1143/2261] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:47 2022] POST /identity/v3/users => generated 309 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:48.093923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:48.105401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf86ce1-b7d3-4441-85bf-a22c2b3aefa1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:48.110224 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:48.111072 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:48.111761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:48.112124 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:48.112976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:48.114631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:48.126187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1119/2262] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:48.134603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:48.145476 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f11cb7-6544-425b-a1d1-7d1ec705bef3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:48.151549 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:48.152568 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:48.153094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:48.153508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] PATH_INFO: `/v3/projects/617b4891652d4d16bf8a0e8577484752/users/d7ad27b071884312935a9f43d243e8ca/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:48.177280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=617b4891652d4d16bf8a0e8577484752, user_id=d7ad27b071884312935a9f43d243e8ca, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:48.178714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:48.194251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1144/2263] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:48 2022] PUT /identity/v3/projects/617b4891652d4d16bf8a0e8577484752/users/d7ad27b071884312935a9f43d243e8ca/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:48.198223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:48.212173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2020af7-479f-42a5-bac7-79cd68c12e02 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:48.290374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbce4c-05fc-4871-9bb9-40085bb3ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:48.291037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbce4c-05fc-4871-9bb9-40085bb3ec04 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:48.291342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbce4c-05fc-4871-9bb9-40085bb3ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:48.291621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbce4c-05fc-4871-9bb9-40085bb3ec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:48.292254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbce4c-05fc-4871-9bb9-40085bb3ec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:48.293882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbce4c-05fc-4871-9bb9-40085bb3ec04 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:48.306596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1120/2264] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:48.309748 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:48.321694 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b494ea2-c278-46b1-9a38-82035ddf9587 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:48.327251 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:48.327958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:48.328239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:48.328629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] PATH_INFO: `/v3/projects/617b4891652d4d16bf8a0e8577484752/users/d7ad27b071884312935a9f43d243e8ca/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:48.331426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=617b4891652d4d16bf8a0e8577484752, user_id=d7ad27b071884312935a9f43d243e8ca, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:48.334399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:48.353308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1145/2265] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:48 2022] PUT /identity/v3/projects/617b4891652d4d16bf8a0e8577484752/users/d7ad27b071884312935a9f43d243e8ca/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:49.056601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2aff4-f551-4881-9cba-3a7618f64efe None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:49.057200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2aff4-f551-4881-9cba-3a7618f64efe None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:49.057200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2aff4-f551-4881-9cba-3a7618f64efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:49.088121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a9f2aff4-f551-4881-9cba-3a7618f64efe None None] MFA Rules not processed for user `d7ad27b071884312935a9f43d243e8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:49.089396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a9f2aff4-f551-4881-9cba-3a7618f64efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:49.170289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1121/2266] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:49 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:49.895527 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:49.969532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82608f-cb98-48f1-b31d-a5a6dd65fcc9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:49.982068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:49.982854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:49.983232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:49.984057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] PATH_INFO: `/v3/users/9afb1bb49fb9410b856c8bdcd168a5c9` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:49.985212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afb1bb49fb9410b856c8bdcd168a5c9)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:49.987367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:50.060409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afb1bb49fb9410b856c8bdcd168a5c9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.061069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afb1bb49fb9410b856c8bdcd168a5c9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.063290 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:50.070638 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afb1bb49fb9410b856c8bdcd168a5c9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.080201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afb1bb49fb9410b856c8bdcd168a5c9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.093062 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afb1bb49fb9410b856c8bdcd168a5c9'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.099202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1146/2267] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:49 2022] DELETE /identity/v3/users/9afb1bb49fb9410b856c8bdcd168a5c9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:50.104361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.104885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.104983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.124551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:50.125672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.176407 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:50.190406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1122/2268] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:50.200569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:50.202639 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.268503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6eeec-cbc3-4b35-996c-ef6441e00e53 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:50.272732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:50.273365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.273680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.273972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.286037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:50.287855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:50.299392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1147/2269] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:50.305719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:50.308188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.320955 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f390a-16ce-4437-99ee-51206afd4d27 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:50.325670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:50.326304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.326604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.326870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] PATH_INFO: `/v3/users/7b8e27f025c841d6bd5f3d8fe50935a8` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.327995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8e27f025c841d6bd5f3d8fe50935a8)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:50.329964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:50.379311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8e27f025c841d6bd5f3d8fe50935a8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.380030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8e27f025c841d6bd5f3d8fe50935a8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.393185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8e27f025c841d6bd5f3d8fe50935a8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.400910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8e27f025c841d6bd5f3d8fe50935a8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.401895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8e27f025c841d6bd5f3d8fe50935a8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.416599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1123/2270] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:50 2022] DELETE /identity/v3/users/7b8e27f025c841d6bd5f3d8fe50935a8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:50.594335 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:50.595952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.624793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:50.627051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.630326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6057ee8-dc78-4bea-a8f3-f44c13b9d27d service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:50.723052 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c171df5-8867-45db-9af4-d4a3b40ab570 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:50.726914 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:50.727694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.728029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.728360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] PATH_INFO: `/v3/projects/f40cf5f8252142f9825e0c94e849971c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.730167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40cf5f8252142f9825e0c94e849971c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:50.732967 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:50.750255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:50.751011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.751289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.751681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] PATH_INFO: `/v3/projects/bf27862168e747f49872ab0ba09342e2` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.753126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf27862168e747f49872ab0ba09342e2)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:50.755774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:50.782969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40cf5f8252142f9825e0c94e849971c', 'request_id': 'req-f3f02862-f7f6-4133-86a5-d4982800ddda'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.789208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40cf5f8252142f9825e0c94e849971c', 'request_id': 'req-f3f02862-f7f6-4133-86a5-d4982800ddda'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.796575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40cf5f8252142f9825e0c94e849971c', 'request_id': 'req-f3f02862-f7f6-4133-86a5-d4982800ddda'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.804480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:50.807890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf27862168e747f49872ab0ba09342e2', 'request_id': 'req-897b9786-c315-4bf5-9161-8949c1b357ed'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.810167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] The token cache is being invalidate because project f40cf5f8252142f9825e0c94e849971c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:50.810494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.811535 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.814180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1124/2271] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:50 2022] DELETE /identity/v3/projects/f40cf5f8252142f9825e0c94e849971c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:50.815139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf27862168e747f49872ab0ba09342e2', 'request_id': 'req-897b9786-c315-4bf5-9161-8949c1b357ed'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.818870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:50.820807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.824558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf27862168e747f49872ab0ba09342e2', 'request_id': 'req-897b9786-c315-4bf5-9161-8949c1b357ed'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.833315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:50.837974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] The token cache is being invalidate because project bf27862168e747f49872ab0ba09342e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:50.838517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.839327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-897b9786-c315-4bf5-9161-8949c1b357ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:50.842149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1148/2272] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:50 2022] DELETE /identity/v3/projects/bf27862168e747f49872ab0ba09342e2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:50.847069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b729d9-758b-4aae-a3a5-40df6d58e012 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.847460 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b729d9-758b-4aae-a3a5-40df6d58e012 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.848145 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b729d9-758b-4aae-a3a5-40df6d58e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.872245 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-70b729d9-758b-4aae-a3a5-40df6d58e012 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:50.873465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-70b729d9-758b-4aae-a3a5-40df6d58e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.894114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f02862-f7f6-4133-86a5-d4982800ddda admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:50.936346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1149/2273] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:50.943853 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166f96-7ce6-4582-8f6c-e2f35952f12f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.944132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166f96-7ce6-4582-8f6c-e2f35952f12f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.944399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166f96-7ce6-4582-8f6c-e2f35952f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.954377 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:50.955070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.955344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.955615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] PATH_INFO: `/v3/users/d7ad27b071884312935a9f43d243e8ca` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.956750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ad27b071884312935a9f43d243e8ca)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:50.958797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:50.965691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-42166f96-7ce6-4582-8f6c-e2f35952f12f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:50.967127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-42166f96-7ce6-4582-8f6c-e2f35952f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:50.975312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1150/2274] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:50.979858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42166f96-7ce6-4582-8f6c-e2f35952f12f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:50.991844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42166f96-7ce6-4582-8f6c-e2f35952f12f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:50.997084 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:50.997783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:50.997964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:50.998217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:50.998917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:50.999239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.001257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.014510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1151/2275] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:51.017951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ad27b071884312935a9f43d243e8ca'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.018652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ad27b071884312935a9f43d243e8ca'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.018895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.028684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add1b12-5bcd-4edb-bbb7-0ea2a73d8a5e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.033846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ad27b071884312935a9f43d243e8ca'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.034069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.034697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.034971 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.035229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.035854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.038192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.041903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ad27b071884312935a9f43d243e8ca'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.042626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ad27b071884312935a9f43d243e8ca'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.058171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1125/2276] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:50 2022] DELETE /identity/v3/users/d7ad27b071884312935a9f43d243e8ca => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:51.071966 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1152/2277] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:51.073833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.076133 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:51.114335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:51.159711 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7ec9c-d36d-4dc6-aeca-9d371863fe60 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.230302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.231028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.231627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.231627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.232296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.234216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.257319 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.259607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:51.261513 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1126/2278] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:51.262333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.274089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f38030-3219-449e-8417-69d4f641a42e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.279683 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.280422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.280763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.281099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.282017 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.282988 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e891cc-91c5-4284-b67e-959db7074725 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.283946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.290254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.291074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.291449 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.291792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] PATH_INFO: `/v3/projects/617b4891652d4d16bf8a0e8577484752` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.293161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=617b4891652d4d16bf8a0e8577484752)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.295269 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.297964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1127/2279] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:51.301992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.312360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c8f65-3e88-428f-bf09-3f06a168fa19 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.317123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.317795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.318129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.318455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.319267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.321042 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.333538 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1128/2280] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:06:51.337886 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.348582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa04c1-eaa6-4edc-98d6-bd8e68237670 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.350691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617b4891652d4d16bf8a0e8577484752', 'request_id': 'req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.357921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617b4891652d4d16bf8a0e8577484752', 'request_id': 'req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.366887 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617b4891652d4d16bf8a0e8577484752', 'request_id': 'req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.378059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] The token cache is being invalidate because project 617b4891652d4d16bf8a0e8577484752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:51.378366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.379039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3de39fb6-ea05-4e4f-a87f-8dc72a3c1d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:51.380561 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1153/2281] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:51 2022] DELETE /identity/v3/projects/617b4891652d4d16bf8a0e8577484752 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:51.385508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b5f8-dbd6-4f44-b8dc-49570b4064d3 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.385800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b5f8-dbd6-4f44-b8dc-49570b4064d3 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.386051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b5f8-dbd6-4f44-b8dc-49570b4064d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.406235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1994b5f8-dbd6-4f44-b8dc-49570b4064d3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:51.407498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1994b5f8-dbd6-4f44-b8dc-49570b4064d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:51.409339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798ff41-9c15-4890-aabe-3005df038b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.410089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798ff41-9c15-4890-aabe-3005df038b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.410285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798ff41-9c15-4890-aabe-3005df038b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.410579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798ff41-9c15-4890-aabe-3005df038b15 admin admin] PATH_INFO: `/v3/projects/2d77b629127a40d19c13c6f4842d3212/users/f8985b6e81a54240a7e83e3e0a5dd87c/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.417922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1154/2282] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:51.425826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3268-0c85-4226-b784-086228f42a29 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.425998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798ff41-9c15-4890-aabe-3005df038b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d77b629127a40d19c13c6f4842d3212, user_id=f8985b6e81a54240a7e83e3e0a5dd87c, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.426095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3268-0c85-4226-b784-086228f42a29 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.426358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3268-0c85-4226-b784-086228f42a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.428582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798ff41-9c15-4890-aabe-3005df038b15 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.444300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1129/2283] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:51 2022] PUT /identity/v3/projects/2d77b629127a40d19c13c6f4842d3212/users/f8985b6e81a54240a7e83e3e0a5dd87c/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:51.447299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1bfa3268-0c85-4226-b784-086228f42a29 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:51.448512 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1bfa3268-0c85-4226-b784-086228f42a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:51.455239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.455687 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.456023 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.483461 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:51.486775 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] MFA Rules not processed for user `f8985b6e81a54240a7e83e3e0a5dd87c`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:51.488050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:51.498333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:51.519900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1155/2284] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:51.524200 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa3268-0c85-4226-b784-086228f42a29 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.533664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa3268-0c85-4226-b784-086228f42a29 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.539232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.539839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.540111 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.540372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.541018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:51.541312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.542954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.560838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1156/2285] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:06:51.562380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.564542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1130/2286] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:51.573684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07616-dfcd-48d8-9056-69cd4beab7ea admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.578974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.580215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.580370 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:51.580808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.581087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.581354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.581991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.584136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.617156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1157/2287] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:51.621620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.645766 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5dca2-37bf-47fe-9140-88ac5bfee6a2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.684537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e7b7d-ea7c-434c-83f6-c1564d65a82b admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.690011 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.690661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.690941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.691203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.691839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.693761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.696121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78db6f3cf17421898e1597c65998fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.696736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.696999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.697286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.716523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1158/2288] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:51.720985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.732366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7913d59-0f07-4298-a4ec-b1cceec2a035 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.738021 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.738697 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.738973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.739238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.739893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.741893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.752909 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1159/2289] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:51.757088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.767864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891ec3b-2e46-41a4-8fbd-ad33b7dd7cc7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.768356 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.769890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.773102 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceddeaf-68f5-48ad-bb7e-df6e6d69f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.773718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceddeaf-68f5-48ad-bb7e-df6e6d69f4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.773994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceddeaf-68f5-48ad-bb7e-df6e6d69f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.775296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceddeaf-68f5-48ad-bb7e-df6e6d69f4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.775735 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceddeaf-68f5-48ad-bb7e-df6e6d69f4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.785050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceddeaf-68f5-48ad-bb7e-df6e6d69f4fd admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.785178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1131/2290] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:06:51.795253 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1160/2291] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:51.796867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:51.810523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f103e-130f-4086-8ddb-12b7acb0ba23 service glance] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:51.817143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:51.817892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.818235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.818577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] PATH_INFO: `/v3/projects/ee6bd368e2df4c338af42f9de539cb15/users/e833fe7c15234811808fda3652fec594/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.837915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6bd368e2df4c338af42f9de539cb15, user_id=e833fe7c15234811808fda3652fec594, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:51.842578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:51.853283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:51.867083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1132/2292] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:51 2022] PUT /identity/v3/projects/ee6bd368e2df4c338af42f9de539cb15/users/e833fe7c15234811808fda3652fec594/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:51.871075 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23492d-73e8-4e08-8ead-0fb18e08b841 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:51.871441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23492d-73e8-4e08-8ead-0fb18e08b841 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:51.871776 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23492d-73e8-4e08-8ead-0fb18e08b841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:51.906354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6b23492d-73e8-4e08-8ead-0fb18e08b841 None None] MFA Rules not processed for user `e833fe7c15234811808fda3652fec594`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:51.907053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6b23492d-73e8-4e08-8ead-0fb18e08b841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:51.978492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:51.985673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1161/2293] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:51.990304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.090461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a16a-29ab-40d4-a33e-756465e1903f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.096141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.096977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.097321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.097651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.098515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.100733 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.136081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1133/2294] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:51 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:52.140088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23492d-73e8-4e08-8ead-0fb18e08b841 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.151330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23492d-73e8-4e08-8ead-0fb18e08b841 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.227270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.228004 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.228294 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.228618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.229386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.231365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.265143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1162/2295] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:52 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:52.271238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.286813 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c62ca2-41af-4b13-8e16-6df8a960c65c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.292604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.293426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.293757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.294131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.294909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.297070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.314091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1134/2296] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:52.315258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.327017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e62d8-4876-49b5-9536-d603f7481c02 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.333841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.334806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.335149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.335526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] PATH_INFO: `/v3/projects/30a503e3b4e942eeaed1dc964951ba57/users/2b659db356864d0b8746959e484b140d/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.378739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a503e3b4e942eeaed1dc964951ba57, user_id=2b659db356864d0b8746959e484b140d, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.382031 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.405078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1163/2297] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:52 2022] PUT /identity/v3/projects/30a503e3b4e942eeaed1dc964951ba57/users/2b659db356864d0b8746959e484b140d/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:52.409046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.420651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa335b-e949-400d-8c52-edb6a0edd6bf admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.480893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66233939-9ec8-4c26-ab7b-09e10efeddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.481646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66233939-9ec8-4c26-ab7b-09e10efeddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.481916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66233939-9ec8-4c26-ab7b-09e10efeddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.482180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66233939-9ec8-4c26-ab7b-09e10efeddc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.482906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66233939-9ec8-4c26-ab7b-09e10efeddc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.484567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66233939-9ec8-4c26-ab7b-09e10efeddc4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.495392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1135/2298] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:52.499597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.510770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7bda1-50c8-407a-a83f-5566b1760bf1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.515938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.516600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.516882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.517137 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] PATH_INFO: `/v3/projects/30a503e3b4e942eeaed1dc964951ba57/users/2b659db356864d0b8746959e484b140d/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.519255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a503e3b4e942eeaed1dc964951ba57, user_id=2b659db356864d0b8746959e484b140d, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.521921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.534194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1164/2299] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:52 2022] PUT /identity/v3/projects/30a503e3b4e942eeaed1dc964951ba57/users/2b659db356864d0b8746959e484b140d/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:52.546856 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd222b-20d2-42fa-82c0-34aca676bc25 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.547145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd222b-20d2-42fa-82c0-34aca676bc25 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.547408 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd222b-20d2-42fa-82c0-34aca676bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.579233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-addd222b-20d2-42fa-82c0-34aca676bc25 None None] MFA Rules not processed for user `2b659db356864d0b8746959e484b140d`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:52.580639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-addd222b-20d2-42fa-82c0-34aca676bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:52.647995 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:52.659982 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1136/2300] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:06:52.671790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.673574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:52.735214 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797980f-a303-4759-acfe-0d4eb84014f9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.738857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.739495 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.739771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.740040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.749708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.751170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.761338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1165/2301] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:52.847972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd222b-20d2-42fa-82c0-34aca676bc25 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:52.859847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd222b-20d2-42fa-82c0-34aca676bc25 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:52.864298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ea7a-438f-4dec-8130-134bce6cd2d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:52.864910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ea7a-438f-4dec-8130-134bce6cd2d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:52.865182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ea7a-438f-4dec-8130-134bce6cd2d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:52.865451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ea7a-438f-4dec-8130-134bce6cd2d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:52.937724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ea7a-438f-4dec-8130-134bce6cd2d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:52.939165 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ea7a-438f-4dec-8130-134bce6cd2d1 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:52.949236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1137/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:57.039936 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:57.042235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:57.120843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:57.139467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23e8b-d4c5-494a-8fd6-62f5bcc27076 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:57.144716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:57.145350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:57.145618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:57.145874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] PATH_INFO: `/v3/users/84cc4d1250a047f2a994beab54d9f3e8` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:57.147092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84cc4d1250a047f2a994beab54d9f3e8)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:57.149169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:57.207292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84cc4d1250a047f2a994beab54d9f3e8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.208037 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84cc4d1250a047f2a994beab54d9f3e8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.218052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84cc4d1250a047f2a994beab54d9f3e8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.232337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84cc4d1250a047f2a994beab54d9f3e8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.246408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84cc4d1250a047f2a994beab54d9f3e8'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.252951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1166/2303] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:06:57 2022] DELETE /identity/v3/users/84cc4d1250a047f2a994beab54d9f3e8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:06:57.258269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:57.258972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:57.258972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:57.280656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:57.284948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:57.381121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1138/2304] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:57.391985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:57.393520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:57.462066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aed88-6c2d-4ee7-8eb4-7ef43e3d8a5c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:57.466939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362168fd-eb27-4975-91f6-a3a586ab9e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:57.467663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362168fd-eb27-4975-91f6-a3a586ab9e77 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:57.467918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362168fd-eb27-4975-91f6-a3a586ab9e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:57.468186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362168fd-eb27-4975-91f6-a3a586ab9e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:57.478310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362168fd-eb27-4975-91f6-a3a586ab9e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:57.479877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362168fd-eb27-4975-91f6-a3a586ab9e77 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:57.490847 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1167/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:06:57.814375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:57.815892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:57.836971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ac76d-61ba-430c-b277-1d43e391141c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:57.843378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:57.844198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:57.844474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:57.844861 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] PATH_INFO: `/v3/projects/5dc5a3f0d4fa48cf9212a7ecb4bc55ff` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:57.846205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc5a3f0d4fa48cf9212a7ecb4bc55ff)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:57.848432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:57.901949 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc5a3f0d4fa48cf9212a7ecb4bc55ff', 'request_id': 'req-9c80de8e-a6c0-4d35-8221-205b1db9cd66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.909284 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc5a3f0d4fa48cf9212a7ecb4bc55ff', 'request_id': 'req-9c80de8e-a6c0-4d35-8221-205b1db9cd66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.919684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc5a3f0d4fa48cf9212a7ecb4bc55ff', 'request_id': 'req-9c80de8e-a6c0-4d35-8221-205b1db9cd66'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.933953 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] The token cache is being invalidate because project 5dc5a3f0d4fa48cf9212a7ecb4bc55ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:06:57.934207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.935060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9c80de8e-a6c0-4d35-8221-205b1db9cd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:06:57.937220 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1139/2306] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:06:57 2022] DELETE /identity/v3/projects/5dc5a3f0d4fa48cf9212a7ecb4bc55ff => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:57.942686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d03bd2-2905-4947-a719-129f7bd05f83 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:57.942974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d03bd2-2905-4947-a719-129f7bd05f83 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:57.944481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d03bd2-2905-4947-a719-129f7bd05f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:57.964509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d4d03bd2-2905-4947-a719-129f7bd05f83 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:57.965761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d4d03bd2-2905-4947-a719-129f7bd05f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:58.035210 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1168/2307] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:58.049743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b26c7c-77d9-4bc5-9944-049bfb2f0bc6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.050236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b26c7c-77d9-4bc5-9944-049bfb2f0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.050744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b26c7c-77d9-4bc5-9944-049bfb2f0bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.078399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f4b26c7c-77d9-4bc5-9944-049bfb2f0bc6 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:58.079742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f4b26c7c-77d9-4bc5-9944-049bfb2f0bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:58.092410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1140/2308] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:58.097209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d03bd2-2905-4947-a719-129f7bd05f83 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:58.109158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d03bd2-2905-4947-a719-129f7bd05f83 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:58.114201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:58.114851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.115120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.115381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.116064 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:06:58.116358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:58.118044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:58.132581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1169/2309] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:06:58.138419 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b26c7c-77d9-4bc5-9944-049bfb2f0bc6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:58.150479 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b26c7c-77d9-4bc5-9944-049bfb2f0bc6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:58.156932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:58.157516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.157789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.158061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.158741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:58.160751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:58.167457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:58.196351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1141/2310] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:06:58 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:58.201087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:58.207167 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:58.214873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031f0a-4509-4d40-91bc-c1b337228a69 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:58.279203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:58.280122 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.280596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.281069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.282180 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:58.285877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:58.319981 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1170/2311] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:06:58 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:06:58.324406 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:58.336676 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abfbd0-63bb-43ba-bc28-c7bd8599c2a0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:58.342583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:58.343227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.343506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.346514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.346514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:58.346514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:58.358611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1142/2312] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:58.362874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:58.373466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfafe6-7145-4bc2-87e4-ca0519fd0107 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:58.379083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c2f3a-9846-4a0a-aaa9-c5f2e47ad873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:58.379705 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2f3a-9846-4a0a-aaa9-c5f2e47ad873 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.379983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2f3a-9846-4a0a-aaa9-c5f2e47ad873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.380249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2f3a-9846-4a0a-aaa9-c5f2e47ad873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.380905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2f3a-9846-4a0a-aaa9-c5f2e47ad873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:58.382706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2f3a-9846-4a0a-aaa9-c5f2e47ad873 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:58.394190 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1171/2313] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:06:58.398880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:58.410157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d3f9-1e32-4d9b-a232-ccf90b939e88 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:58.416236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:58.416969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.417252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.417520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] PATH_INFO: `/v3/projects/18ca8cf88c9a4c4da79b740d45f9fdff/users/3953146fa9c04656b453fa8b5c953c85/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.439772 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ca8cf88c9a4c4da79b740d45f9fdff, user_id=3953146fa9c04656b453fa8b5c953c85, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:58.442699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:58.458179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1143/2314] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:06:58 2022] PUT /identity/v3/projects/18ca8cf88c9a4c4da79b740d45f9fdff/users/3953146fa9c04656b453fa8b5c953c85/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:06:58.463972 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a626dd-d5d0-4f2a-9ff5-9dda5d90152a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.464254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a626dd-d5d0-4f2a-9ff5-9dda5d90152a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.464550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a626dd-d5d0-4f2a-9ff5-9dda5d90152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.486407 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-01a626dd-d5d0-4f2a-9ff5-9dda5d90152a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:06:58.487753 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-01a626dd-d5d0-4f2a-9ff5-9dda5d90152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:58.570577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1172/2315] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:06:58.580828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:06:58.582648 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:06:58.650212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc6235-27dc-426e-8f89-3440e80c64d1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:06:58.655295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:06:58.656581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:06:58.657049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:06:58.657486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:06:58.673417 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:06:58.675115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:06:58.686374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1144/2316] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:04.396503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174294-5c19-4b34-a01f-a914ab6e0245 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:04.397093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174294-5c19-4b34-a01f-a914ab6e0245 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:04.397093 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174294-5c19-4b34-a01f-a914ab6e0245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:04.437591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-f7174294-5c19-4b34-a01f-a914ab6e0245 None None] MFA Rules not processed for user `3953146fa9c04656b453fa8b5c953c85`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:04.439702 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-f7174294-5c19-4b34-a01f-a914ab6e0245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:04.562255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1173/2317] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:04.568064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:04.587965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498d589-546e-4474-b095-d492ff3af9bc service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:04.594141 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:04.595353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:04.595891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:04.596288 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:04.597087 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:04.599270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:04.641121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1145/2318] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:04 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:04.645532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7174294-5c19-4b34-a01f-a914ab6e0245 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:04.660915 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7174294-5c19-4b34-a01f-a914ab6e0245 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:04.678017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:04.761022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:04.761745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:04.762169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:04.762369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:04.763099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:04.765092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:04.790048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1174/2319] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:04 2022] POST /identity/v3/users => generated 298 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:04.795573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:04.808550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf60f5b-d2a7-4548-851f-8144016fbe54 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:04.813815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:04.814504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:04.814853 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:04.815135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:04.815850 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:04.817577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:04.831969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1146/2320] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:04.837361 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:04.852576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513923c-ce81-4c32-a932-60f7fffe5534 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:04.861409 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:04.862864 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:04.863494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:04.864142 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] PATH_INFO: `/v3/projects/004ee01fb90a4b82afe4d41f84cc8cb1/users/fc17912276814124af2cc33cb13015cc/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:04.896816 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004ee01fb90a4b82afe4d41f84cc8cb1, user_id=fc17912276814124af2cc33cb13015cc, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:04.902545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:04.924356 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1175/2321] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:04 2022] PUT /identity/v3/projects/004ee01fb90a4b82afe4d41f84cc8cb1/users/fc17912276814124af2cc33cb13015cc/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:04.930681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:04.945625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deec83b-614f-4e6b-abae-d959760fcfe2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:05.027642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05196bd-0c3f-4327-a467-cb78b5a17033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:05.028739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05196bd-0c3f-4327-a467-cb78b5a17033 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:05.029238 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05196bd-0c3f-4327-a467-cb78b5a17033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:05.030669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05196bd-0c3f-4327-a467-cb78b5a17033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:05.031618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05196bd-0c3f-4327-a467-cb78b5a17033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:05.033304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05196bd-0c3f-4327-a467-cb78b5a17033 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:05.046347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1147/2322] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:05.051397 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:05.063851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a9d0e-9701-4097-a566-d73fe911af65 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:05.078789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:05.078789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:05.079852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:05.080160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] PATH_INFO: `/v3/projects/004ee01fb90a4b82afe4d41f84cc8cb1/users/fc17912276814124af2cc33cb13015cc/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:05.084134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] RBAC: Authorizing `identity:create_grant(project_id=004ee01fb90a4b82afe4d41f84cc8cb1, user_id=fc17912276814124af2cc33cb13015cc, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:05.089818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:05.147149 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1176/2323] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:05 2022] PUT /identity/v3/projects/004ee01fb90a4b82afe4d41f84cc8cb1/users/fc17912276814124af2cc33cb13015cc/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:13.052239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6042c5a-d9ed-40db-bb4b-54d82bc5859b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:13.053213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6042c5a-d9ed-40db-bb4b-54d82bc5859b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:13.053213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6042c5a-d9ed-40db-bb4b-54d82bc5859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:13.140948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d6042c5a-d9ed-40db-bb4b-54d82bc5859b None None] MFA Rules not processed for user `fc17912276814124af2cc33cb13015cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:13.143962 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d6042c5a-d9ed-40db-bb4b-54d82bc5859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:13.193295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:13.411204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1148/2324] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:13.424774 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:13.429217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:13.533047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a168d9d-6b58-4211-b3c7-b5f20c4d13af admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:13.542752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78db6f3cf17421898e1597c65998fad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:13.543736 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:13.544321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:13.544770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:13.642922 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:13.644739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:13.661649 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1177/2325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:13.852516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:13.852794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:13.853431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:13.874909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:13.876175 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:13.946163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1149/2326] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:13.971888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:13.974615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:13.999996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:14.084450 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c23d76-54d9-490a-a38b-3cf7650ddb95 service glance] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:14.092803 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d420b7-8c6c-4291-8216-3717ccf00562 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:14.093559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d420b7-8c6c-4291-8216-3717ccf00562 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:14.095120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d420b7-8c6c-4291-8216-3717ccf00562 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:14.095522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d420b7-8c6c-4291-8216-3717ccf00562 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:14.120278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d420b7-8c6c-4291-8216-3717ccf00562 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:14.123176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d420b7-8c6c-4291-8216-3717ccf00562 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:14.140219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1178/2327] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:07:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:07:16.533423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:16.536201 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:16.684599 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae609f6-a6a8-4fdd-9456-711535395e8f None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:16.700179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:16.701447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:16.701846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:16.702788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] PATH_INFO: `/v3/users/f8985b6e81a54240a7e83e3e0a5dd87c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:16.705436 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8985b6e81a54240a7e83e3e0a5dd87c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:16.711719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:16.807557 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8985b6e81a54240a7e83e3e0a5dd87c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:16.809566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8985b6e81a54240a7e83e3e0a5dd87c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:16.818261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:16.837747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8985b6e81a54240a7e83e3e0a5dd87c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:16.851677 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8985b6e81a54240a7e83e3e0a5dd87c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:16.853448 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8985b6e81a54240a7e83e3e0a5dd87c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:16.885552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1150/2328] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:16 2022] DELETE /identity/v3/users/f8985b6e81a54240a7e83e3e0a5dd87c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:16.892067 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:16.892920 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:16.893099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:16.951946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:16.954320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:17.107041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1179/2329] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:17.126060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:17.128717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:17.340974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08268a-0d81-4dcb-93b6-0101f4f84b8c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:17.355548 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:17.356665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:17.357002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:17.357331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:17.377803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:17.379590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:17.396917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1151/2330] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:17.975741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:17.977689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:18.008980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8a73-b34a-4a55-a49c-59de418db639 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:18.024098 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:18.025183 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:18.025695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:18.026177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] PATH_INFO: `/v3/projects/2d77b629127a40d19c13c6f4842d3212` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:18.028637 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d77b629127a40d19c13c6f4842d3212)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:18.032331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:18.131925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d77b629127a40d19c13c6f4842d3212', 'request_id': 'req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:18.151483 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d77b629127a40d19c13c6f4842d3212', 'request_id': 'req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:18.168537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d77b629127a40d19c13c6f4842d3212', 'request_id': 'req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:18.207134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] The token cache is being invalidate because project 2d77b629127a40d19c13c6f4842d3212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:18.208176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:18.210279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:18.214107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1180/2331] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:17 2022] DELETE /identity/v3/projects/2d77b629127a40d19c13c6f4842d3212 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:18.633691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:18.637080 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:18.679695 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d642c1-da43-46ee-855b-4c9dc7b6f587 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:18.786109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:18.787318 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:18.788086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:18.788520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:18.791071 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:18.902753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:18.904661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:18.924471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1152/2332] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:20.076686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:20.079583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:20.216045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:20.367492 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2fc67-39ab-4385-a59e-b4f00a202fb6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:20.397689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:20.398901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:20.399551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:20.400830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:20.408029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:20.635895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:20.637807 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:20.653656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1181/2333] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:25.420239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:25.421754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:25.439306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de2f36-de78-44e5-b3cd-34e2fd7159d5 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:25.444439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:25.445460 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:25.445460 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:25.445729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] PATH_INFO: `/v3/users/89f04c92184043c3a6cd7249340519dd` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:25.446873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f04c92184043c3a6cd7249340519dd)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:25.454106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:25.495158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:25.599646 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f04c92184043c3a6cd7249340519dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:25.600459 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f04c92184043c3a6cd7249340519dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:25.620643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:25.622665 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:25.637720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f04c92184043c3a6cd7249340519dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:25.641987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1982cd7-76b3-4592-b9be-22f889b0ce30 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:25.645781 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f04c92184043c3a6cd7249340519dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:25.646481 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f04c92184043c3a6cd7249340519dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:25.648973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dc820-bbfa-4866-b916-1286ef966398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:25.649603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc820-bbfa-4866-b916-1286ef966398 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:25.650066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc820-bbfa-4866-b916-1286ef966398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:25.650504 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dc820-bbfa-4866-b916-1286ef966398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:25.654538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-938dc820-bbfa-4866-b916-1286ef966398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:25.670617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1153/2334] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:25 2022] DELETE /identity/v3/users/89f04c92184043c3a6cd7249340519dd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:25.681752 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc820-bbfa-4866-b916-1286ef966398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:25.683398 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dc820-bbfa-4866-b916-1286ef966398 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:25.695481 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1182/2335] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:25.934759 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:25.936678 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:26.030295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1939-6cdc-47c9-ad1d-7b30fcd0faff admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:26.034993 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:26.035749 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.036120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.036469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] PATH_INFO: `/v3/projects/df3bcc1c0616492491f5029b13faafa3` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.038079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3bcc1c0616492491f5029b13faafa3)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:26.040211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:26.109574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3bcc1c0616492491f5029b13faafa3', 'request_id': 'req-97d4e6aa-e335-4228-a8bc-b55f981dc15f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:26.117230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3bcc1c0616492491f5029b13faafa3', 'request_id': 'req-97d4e6aa-e335-4228-a8bc-b55f981dc15f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:26.130391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3bcc1c0616492491f5029b13faafa3', 'request_id': 'req-97d4e6aa-e335-4228-a8bc-b55f981dc15f'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:26.146728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] The token cache is being invalidate because project df3bcc1c0616492491f5029b13faafa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:26.146728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:26.147956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-97d4e6aa-e335-4228-a8bc-b55f981dc15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:26.152716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1154/2336] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:25 2022] DELETE /identity/v3/projects/df3bcc1c0616492491f5029b13faafa3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:26.154426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337da5a-2289-4f05-a0a9-b5fe087b7c1d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.154959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337da5a-2289-4f05-a0a9-b5fe087b7c1d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.155424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337da5a-2289-4f05-a0a9-b5fe087b7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.180170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c337da5a-2289-4f05-a0a9-b5fe087b7c1d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:26.181289 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c337da5a-2289-4f05-a0a9-b5fe087b7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:26.259298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1183/2337] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:26.267723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f88d29-b7d9-4daf-91c4-10142284b7f3 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.268070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f88d29-b7d9-4daf-91c4-10142284b7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.268272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f88d29-b7d9-4daf-91c4-10142284b7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.292751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c1f88d29-b7d9-4daf-91c4-10142284b7f3 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:26.294865 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c1f88d29-b7d9-4daf-91c4-10142284b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:26.314940 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1155/2338] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:26.319818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337da5a-2289-4f05-a0a9-b5fe087b7c1d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:26.341121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337da5a-2289-4f05-a0a9-b5fe087b7c1d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:26.352431 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:26.353671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.354530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.355255 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.356458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:26.357186 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:26.360720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:26.381375 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1184/2339] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:26.387624 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f88d29-b7d9-4daf-91c4-10142284b7f3 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:26.399957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f88d29-b7d9-4daf-91c4-10142284b7f3 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:26.410343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:26.410343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.410343 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.410812 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.411184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:26.414153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:26.437115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:26.465211 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1156/2340] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:26 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:26.466633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:26.481043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550fa5ef-cdb5-46f5-93a1-56a01bd13758 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:26.567788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:26.600326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:26.601306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.605008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.605008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.605008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:26.605493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:26.648683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1185/2341] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:26 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:26.649844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:26.671323 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a659a5-8795-42ee-99ff-7a2e64544518 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:26.683168 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:26.684373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.684834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.685280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.686354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:26.688610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:26.702771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1157/2342] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:26.707733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:26.722433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4a871-340c-44ae-809c-99cf8cbb94a5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:26.733895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747beeb0-8d41-4121-a882-45f161a61891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:26.734995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747beeb0-8d41-4121-a882-45f161a61891 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.735577 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747beeb0-8d41-4121-a882-45f161a61891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.736729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747beeb0-8d41-4121-a882-45f161a61891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.738106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747beeb0-8d41-4121-a882-45f161a61891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:26.741836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747beeb0-8d41-4121-a882-45f161a61891 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:26.770628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:26.772347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1186/2343] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:26.787181 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec6ecf-5c59-46e8-880e-57c53871e627 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:26.801499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:26.802462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.803008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.803760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] PATH_INFO: `/v3/projects/0ada7b3c140545e7b6ee9a76f092e624/users/963a3c19350446188949d0e8d078ef2e/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.822751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ada7b3c140545e7b6ee9a76f092e624, user_id=963a3c19350446188949d0e8d078ef2e, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:26.826198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:26.852188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1158/2344] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:26 2022] PUT /identity/v3/projects/0ada7b3c140545e7b6ee9a76f092e624/users/963a3c19350446188949d0e8d078ef2e/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:26.864618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:26.864974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:26.865315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:26.907515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] MFA Rules not processed for user `963a3c19350446188949d0e8d078ef2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:26.908844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:27.043992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1187/2345] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:27.055890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:27.061640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:27.236476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13392ee9-af07-4717-acae-45efde097646 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:27.243916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb7fb0-9374-4e1c-ac20-84fd54cb5fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:27.244802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7fb0-9374-4e1c-ac20-84fd54cb5fdc service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:27.245145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7fb0-9374-4e1c-ac20-84fd54cb5fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:27.246180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb7fb0-9374-4e1c-ac20-84fd54cb5fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:27.260531 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb7fb0-9374-4e1c-ac20-84fd54cb5fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:27.262541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb7fb0-9374-4e1c-ac20-84fd54cb5fdc service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:27.274423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1159/2346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:28.727908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:28.731204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:28.853814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b29f02-1b1e-4ee7-a078-9967cb21c9f5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:28.866082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:28.866947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:28.867223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:28.867494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] PATH_INFO: `/v3/users/e833fe7c15234811808fda3652fec594` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:28.873843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e833fe7c15234811808fda3652fec594)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:28.875854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:28.951842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e833fe7c15234811808fda3652fec594'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:28.952878 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e833fe7c15234811808fda3652fec594'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:28.959051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:28.965551 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e833fe7c15234811808fda3652fec594'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:28.991196 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e833fe7c15234811808fda3652fec594'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:29.027897 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e833fe7c15234811808fda3652fec594'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:29.040503 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1188/2347] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:28 2022] DELETE /identity/v3/users/e833fe7c15234811808fda3652fec594 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:29.048202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:29.048811 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:29.049077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:29.116867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:29.123843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:29.360159 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1160/2348] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:29.384445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:29.387223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:29.544389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212199-40a8-4c5c-b48a-284226d163fc admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:29.553883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:29.554530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:29.554835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:29.555105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:29.577282 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:29.579403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:29.591232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1189/2349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:30.249730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:30.252985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:30.267193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63741-5b4a-4a56-9c1a-5eb0e03c139b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:30.292551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:30.293932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:30.294254 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:30.295007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] PATH_INFO: `/v3/projects/ee6bd368e2df4c338af42f9de539cb15` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:30.296314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6bd368e2df4c338af42f9de539cb15)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:30.298294 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:30.371843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6bd368e2df4c338af42f9de539cb15', 'request_id': 'req-69ad8949-7504-45a7-b345-016bb566a16d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.382816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:30.385074 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6bd368e2df4c338af42f9de539cb15', 'request_id': 'req-69ad8949-7504-45a7-b345-016bb566a16d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.397085 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6bd368e2df4c338af42f9de539cb15', 'request_id': 'req-69ad8949-7504-45a7-b345-016bb566a16d'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.425774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] The token cache is being invalidate because project ee6bd368e2df4c338af42f9de539cb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:30.426454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.427028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-69ad8949-7504-45a7-b345-016bb566a16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.430620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1161/2350] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:30 2022] DELETE /identity/v3/projects/ee6bd368e2df4c338af42f9de539cb15 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:30.433379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:30.437903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:30.438447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:30.438987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:30.450908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fbe37-8508-4925-9685-db3d92e0a768 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:30.461575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] MFA Rules not processed for user `3953146fa9c04656b453fa8b5c953c85`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:30.462833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:30.548844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1162/2351] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:30.567045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:30.567862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:30.568198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:30.569614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] PATH_INFO: `/v3/users/2b659db356864d0b8746959e484b140d` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:30.570975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b659db356864d0b8746959e484b140d)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:30.573072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:30.661347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b659db356864d0b8746959e484b140d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.662725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b659db356864d0b8746959e484b140d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.671814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b659db356864d0b8746959e484b140d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.680739 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b659db356864d0b8746959e484b140d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.691321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:30.703016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-3b803346-8bce-4a9d-a6f4-c2566fe57b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b659db356864d0b8746959e484b140d'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:30.710811 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1190/2352] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:30 2022] DELETE /identity/v3/users/2b659db356864d0b8746959e484b140d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:31.386233 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:31.388278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:31.419598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee910-fb4d-44f7-98cd-391472ee31b5 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:31.530234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:31.531077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:31.531352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:31.532064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] PATH_INFO: `/v3/projects/30a503e3b4e942eeaed1dc964951ba57` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:31.532936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a503e3b4e942eeaed1dc964951ba57)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:31.534987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:31.606760 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a503e3b4e942eeaed1dc964951ba57', 'request_id': 'req-a1555adc-35c5-4450-a5e0-a4042feea983'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:31.615178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a503e3b4e942eeaed1dc964951ba57', 'request_id': 'req-a1555adc-35c5-4450-a5e0-a4042feea983'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:31.629984 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a503e3b4e942eeaed1dc964951ba57', 'request_id': 'req-a1555adc-35c5-4450-a5e0-a4042feea983'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:31.644965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] The token cache is being invalidate because project 30a503e3b4e942eeaed1dc964951ba57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:31.645214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:31.651066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1555adc-35c5-4450-a5e0-a4042feea983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:31.653029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1163/2353] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:31 2022] DELETE /identity/v3/projects/30a503e3b4e942eeaed1dc964951ba57 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:31.658047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1dbd-5ea3-4227-b55e-55b139cd31c2 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:31.658485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1dbd-5ea3-4227-b55e-55b139cd31c2 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:31.658485 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1dbd-5ea3-4227-b55e-55b139cd31c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:31.679729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-08be1dbd-5ea3-4227-b55e-55b139cd31c2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:31.681081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-08be1dbd-5ea3-4227-b55e-55b139cd31c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:31.757252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1191/2354] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:31.766578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29275ca-e8cc-4431-b039-972ea3ca9f53 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:31.766971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29275ca-e8cc-4431-b039-972ea3ca9f53 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:31.767228 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29275ca-e8cc-4431-b039-972ea3ca9f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:31.791289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-c29275ca-e8cc-4431-b039-972ea3ca9f53 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:31.792614 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c29275ca-e8cc-4431-b039-972ea3ca9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:31.801604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1164/2355] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:31.806185 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be1dbd-5ea3-4227-b55e-55b139cd31c2 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:31.827555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be1dbd-5ea3-4227-b55e-55b139cd31c2 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:31.846932 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:31.848046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:31.848341 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:31.848643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:31.849299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:31.849650 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:31.851400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:31.865759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1192/2356] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:31.870024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29275ca-e8cc-4431-b039-972ea3ca9f53 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:31.882665 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29275ca-e8cc-4431-b039-972ea3ca9f53 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:31.888747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:31.889304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:31.889580 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:31.889848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:31.890516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:31.892526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:31.906518 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:31.943338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1165/2357] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:31 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:31.945010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:31.962126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bccbc7-492d-40cf-9807-61364c5b81a7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:32.071872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:32.073408 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.073977 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.074690 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.076315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:32.081130 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:32.129718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1193/2358] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:31 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:32.134929 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:32.148192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b23594-6eb4-4ac5-96a5-5a2603b9ae18 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:32.166443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:32.168192 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.168829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.169371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.170306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:32.172718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:32.189372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1166/2359] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:32.194698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:32.220786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97960d8-5ad7-40f1-9d4d-7b081a7588e9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:32.225944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab679e-a694-4de8-9b37-f2804823f67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:32.226892 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab679e-a694-4de8-9b37-f2804823f67d admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.227277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab679e-a694-4de8-9b37-f2804823f67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.227664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab679e-a694-4de8-9b37-f2804823f67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.228429 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab679e-a694-4de8-9b37-f2804823f67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:32.231348 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab679e-a694-4de8-9b37-f2804823f67d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:32.245886 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1194/2360] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:32.250736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:32.262303 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9696e-ac5c-4046-9c68-8a670ca12ff5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:32.268153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:32.269088 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.269467 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.269823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] PATH_INFO: `/v3/projects/edd0507f0110437babc71e810a81939d/users/370d0f1c61704066b21bb65c90d9d6dd/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.289443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd0507f0110437babc71e810a81939d, user_id=370d0f1c61704066b21bb65c90d9d6dd, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:32.292567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:32.316695 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1167/2361] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:32 2022] PUT /identity/v3/projects/edd0507f0110437babc71e810a81939d/users/370d0f1c61704066b21bb65c90d9d6dd/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:32.327958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d5bb-1a09-4199-ba86-bce7f87e5213 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.328252 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d5bb-1a09-4199-ba86-bce7f87e5213 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.328509 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d5bb-1a09-4199-ba86-bce7f87e5213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.377313 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-b062d5bb-1a09-4199-ba86-bce7f87e5213 None None] MFA Rules not processed for user `370d0f1c61704066b21bb65c90d9d6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:32.378592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b062d5bb-1a09-4199-ba86-bce7f87e5213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:32.452732 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:32.489948 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1195/2362] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:32.491617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:32.629391 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488cfb7-7ca4-4505-a3b3-548b0b9f890e admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:32.635900 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:32.636640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.636918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.637182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.637833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:32.639857 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:32.687119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1168/2363] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:32 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:32.688526 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d5bb-1a09-4199-ba86-bce7f87e5213 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:32.702298 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d5bb-1a09-4199-ba86-bce7f87e5213 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:32.828926 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:32.830312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.831030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.831788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.833201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:32.837404 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:32.896181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1196/2364] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:32 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:32.897239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:32.923613 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7b08-96f4-419d-ba2c-a98efd6e2bed admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:32.940991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:32.941670 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:32.942625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:32.942916 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:32.943607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:32.949968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:32.991276 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1169/2365] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:32.995663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:33.033223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ebbf1-ddcd-42cb-b04a-00c1a9e41a95 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:33.054104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeae55a-8c94-4827-9cd2-3a04a7f5d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:33.055209 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae55a-8c94-4827-9cd2-3a04a7f5d3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:33.055643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae55a-8c94-4827-9cd2-3a04a7f5d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:33.056070 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae55a-8c94-4827-9cd2-3a04a7f5d3d1 admin admin] PATH_INFO: `/v3/projects/5570bc291345423192fc3eb0dcc18a80/users/6d662d9fdc4a4921b6c68ecd787918c6/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:33.112530 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeae55a-8c94-4827-9cd2-3a04a7f5d3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5570bc291345423192fc3eb0dcc18a80, user_id=6d662d9fdc4a4921b6c68ecd787918c6, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:33.123950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeae55a-8c94-4827-9cd2-3a04a7f5d3d1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:33.163862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1197/2366] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:32 2022] PUT /identity/v3/projects/5570bc291345423192fc3eb0dcc18a80/users/6d662d9fdc4a4921b6c68ecd787918c6/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:33.166652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:33.194285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b5230-eead-4980-89ee-e08bd180594f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:33.376937 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:33.377297 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:33.377522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:33.394925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:33.396904 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:33.397244 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:33.397753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:33.398492 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:33.400603 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:33.414714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1170/2367] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:33.418797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:33.433234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9dfc2-0807-45b8-af38-0696d6600d41 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:33.433520 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:33.438153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:33.446514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff67501-8a45-433d-9ab4-a898133433f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:33.447390 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67501-8a45-433d-9ab4-a898133433f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:33.448198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67501-8a45-433d-9ab4-a898133433f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:33.448198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff67501-8a45-433d-9ab4-a898133433f4 admin admin] PATH_INFO: `/v3/projects/5570bc291345423192fc3eb0dcc18a80/users/6d662d9fdc4a4921b6c68ecd787918c6/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:33.452948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff67501-8a45-433d-9ab4-a898133433f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5570bc291345423192fc3eb0dcc18a80, user_id=6d662d9fdc4a4921b6c68ecd787918c6, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:33.460499 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff67501-8a45-433d-9ab4-a898133433f4 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:33.488954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1171/2368] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:33 2022] PUT /identity/v3/projects/5570bc291345423192fc3eb0dcc18a80/users/6d662d9fdc4a4921b6c68ecd787918c6/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:33.518889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:33.519530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:33.519530 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:33.558619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:33.567378 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] MFA Rules not processed for user `6d662d9fdc4a4921b6c68ecd787918c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:33.571959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:33.606177 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1198/2369] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 11 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:33.611604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:33.617717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:33.776552 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:33.795856 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1172/2370] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:33.804878 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:33.807627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:33.825339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94066ae-4851-4ba7-ac30-afa3cc21d680 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:33.954506 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb8ffc-f856-4373-855b-edeebc43d06b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:33.965279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:33.966246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:33.967474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:33.968022 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:33.986869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:33.987945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:33.988717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:33.989096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:33.990147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:33.994167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:34.011756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1173/2371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:34.090133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:34.093879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:34.105133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1199/2372] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:07:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:07:34.921918 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:34.972572 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9c1a-37bf-459c-b67d-d690da7ee14b service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:34.991266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d662d9fdc4a4921b6c68ecd787918c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5570bc291345423192fc3eb0dcc18a80', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:34.993437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:34.993835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:34.996533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:34.998884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:35.000412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:35.007055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:35.043837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1174/2373] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:35.045386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:35.063905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14a9f8-48dc-44e0-ab62-2861a2bbde3e service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:35.077718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d662d9fdc4a4921b6c68ecd787918c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5570bc291345423192fc3eb0dcc18a80', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:35.078535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:35.078958 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:35.079332 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:35.080096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:35.082171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:35.166212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1200/2374] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:35 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:35.170524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:35.199210 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a183dad-1e1b-44f6-b7f2-d667e40f53a4 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:35.397817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d662d9fdc4a4921b6c68ecd787918c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5570bc291345423192fc3eb0dcc18a80', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:35.399113 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:35.399722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:35.401347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:35.402154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:35.402524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:35.404581 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:35.431834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1175/2375] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:35.526317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:35.567614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ff07d-86fd-467d-bf9b-f7613a8fff98 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:35.596291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d662d9fdc4a4921b6c68ecd787918c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5570bc291345423192fc3eb0dcc18a80', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:35.596985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:35.597267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:35.597540 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] PATH_INFO: `/v3/projects/a101e17655d8491e817c63dfccfc0a30` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:35.603232 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a101e17655d8491e817c63dfccfc0a30)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:35.612647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:35.733730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a101e17655d8491e817c63dfccfc0a30', 'request_id': 'req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:35.745295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a101e17655d8491e817c63dfccfc0a30', 'request_id': 'req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:35.762489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a101e17655d8491e817c63dfccfc0a30', 'request_id': 'req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:35.792113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] The token cache is being invalidate because project a101e17655d8491e817c63dfccfc0a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:35.793410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:35.795033 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:35.800942 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1201/2376] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:35 2022] DELETE /identity/v3/projects/a101e17655d8491e817c63dfccfc0a30 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:36.341726 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:36.343799 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:36.407707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:36.602399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f10d07-db01-40c6-a2f3-06a110805df1 tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:36.850273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:36.855245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:36.855746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:36.857644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] PATH_INFO: `/v3/users/370d0f1c61704066b21bb65c90d9d6dd` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:36.865286 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370d0f1c61704066b21bb65c90d9d6dd)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:36.871131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:37.024055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370d0f1c61704066b21bb65c90d9d6dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.026081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370d0f1c61704066b21bb65c90d9d6dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.065443 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370d0f1c61704066b21bb65c90d9d6dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.098958 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370d0f1c61704066b21bb65c90d9d6dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.101994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9a9b247d-7f97-4890-8b87-92b383d87129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370d0f1c61704066b21bb65c90d9d6dd'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.136392 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:37.138741 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:37.144926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1176/2377] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:36 2022] DELETE /identity/v3/users/370d0f1c61704066b21bb65c90d9d6dd => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:37.149802 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:37.150152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:37.150346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:37.158501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:37.189545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fcfa4-22e6-41e5-9643-c01412dce7ad tempest-VolumeQuotaClassesTest-1258744495 tempest-VolumeQuotaClassesTest-1258744495-project-admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:37.192756 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:37.194047 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:37.290229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:37.291390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:37.291913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:37.292474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] PATH_INFO: `/v3/users/7c10a8e7bbdb435889bee8d4ec987f6b` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:37.294198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c10a8e7bbdb435889bee8d4ec987f6b)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:37.297898 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:37.305947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:37.334629 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1177/2378] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:37.345926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:37.348198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:37.433883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c10a8e7bbdb435889bee8d4ec987f6b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.434674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c10a8e7bbdb435889bee8d4ec987f6b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.457989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c10a8e7bbdb435889bee8d4ec987f6b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.473337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c10a8e7bbdb435889bee8d4ec987f6b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.474179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7ff77-7be8-4f6f-a3fb-f2a1b112d14c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:37.479948 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:37.480927 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:37.481385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:37.481823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:37.494516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c10a8e7bbdb435889bee8d4ec987f6b'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:37.496663 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:37.500018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:37.506604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1202/2379] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:37 2022] DELETE /identity/v3/users/7c10a8e7bbdb435889bee8d4ec987f6b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:37.534051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1178/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:37.733761 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:37.735599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:37.934222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65120c62-7370-4792-ad25-2db911dc95e7 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:37.956772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:37.958046 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:37.958652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:37.959206 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] PATH_INFO: `/v3/users/963a3c19350446188949d0e8d078ef2e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:37.967743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] RBAC: Authorizing `identity:delete_user(user_id=963a3c19350446188949d0e8d078ef2e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:37.991393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:38.069634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:38.072473 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:38.075920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:38.111059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b02480-c435-400b-b4a3-c53e40ec17b3 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:38.116301 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:38.117154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:38.117457 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:38.117737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] PATH_INFO: `/v3/projects/69416126de6b418daba86201e3d2ccd0` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:38.119131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69416126de6b418daba86201e3d2ccd0)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:38.121337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:38.157237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963a3c19350446188949d0e8d078ef2e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.157995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963a3c19350446188949d0e8d078ef2e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.175583 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963a3c19350446188949d0e8d078ef2e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.193616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963a3c19350446188949d0e8d078ef2e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.226757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-f772fbe6-479b-4701-8293-eaeffc05317c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963a3c19350446188949d0e8d078ef2e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.243374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1203/2381] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:37 2022] DELETE /identity/v3/users/963a3c19350446188949d0e8d078ef2e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:38.244710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69416126de6b418daba86201e3d2ccd0', 'request_id': 'req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.249706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:38.250040 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:38.250246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:38.262714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69416126de6b418daba86201e3d2ccd0', 'request_id': 'req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.290125 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69416126de6b418daba86201e3d2ccd0', 'request_id': 'req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.290911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:38.292888 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:38.337178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] The token cache is being invalidate because project 69416126de6b418daba86201e3d2ccd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:38.338779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.342471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.346652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1179/2382] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:38 2022] DELETE /identity/v3/projects/69416126de6b418daba86201e3d2ccd0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:38.351296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:38.355936 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:38.464499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1204/2383] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:38.465440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:38.468572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:38.534383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b5ee0-7087-4f28-bbdb-43e1b713763e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:38.559626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:38.560795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:38.561263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:38.562010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] PATH_INFO: `/v3/users/b369c1f326b64cb1a8f23fe450724e2c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:38.565133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b369c1f326b64cb1a8f23fe450724e2c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:38.569327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:38.614719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf99d8-1b16-42ca-b1e5-aa9ac3396c29 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:38.631263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:38.632590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:38.633163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:38.633654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] PATH_INFO: `/v3/projects/edd0507f0110437babc71e810a81939d` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:38.635551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd0507f0110437babc71e810a81939d)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:38.638204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:38.687369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:38.752117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd0507f0110437babc71e810a81939d', 'request_id': 'req-cbb2d5b6-b125-42a9-939e-0be146321c61'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.760903 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b369c1f326b64cb1a8f23fe450724e2c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.762151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b369c1f326b64cb1a8f23fe450724e2c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.764602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd0507f0110437babc71e810a81939d', 'request_id': 'req-cbb2d5b6-b125-42a9-939e-0be146321c61'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.781714 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd0507f0110437babc71e810a81939d', 'request_id': 'req-cbb2d5b6-b125-42a9-939e-0be146321c61'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.801135 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b369c1f326b64cb1a8f23fe450724e2c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.804101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] The token cache is being invalidate because project edd0507f0110437babc71e810a81939d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:38.804444 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.805906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.808536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1180/2384] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:38 2022] DELETE /identity/v3/projects/edd0507f0110437babc71e810a81939d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:38.810002 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:38.812122 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:38.829044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b369c1f326b64cb1a8f23fe450724e2c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.853030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b369c1f326b64cb1a8f23fe450724e2c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:38.862626 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1205/2385] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:38 2022] DELETE /identity/v3/users/b369c1f326b64cb1a8f23fe450724e2c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:38.863603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:38.865231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:38.893964 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:38.944947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2d5b6-b125-42a9-939e-0be146321c61 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:39.007772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb0d43-6f2d-4eb9-872d-b2aa90a83527 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:39.019358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:39.022326 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:39.022975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:39.024202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] PATH_INFO: `/v3/users/6d662d9fdc4a4921b6c68ecd787918c6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:39.028838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d662d9fdc4a4921b6c68ecd787918c6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:39.032839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:39.034485 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:39.035570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:39.035909 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:39.036240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:39.038737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:39.055064 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:39.056686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:39.069259 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1181/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:39.146082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d662d9fdc4a4921b6c68ecd787918c6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:39.147380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d662d9fdc4a4921b6c68ecd787918c6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:39.158363 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d662d9fdc4a4921b6c68ecd787918c6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:39.168858 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d662d9fdc4a4921b6c68ecd787918c6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:39.212660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d662d9fdc4a4921b6c68ecd787918c6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:39.233687 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1206/2387] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:38 2022] DELETE /identity/v3/users/6d662d9fdc4a4921b6c68ecd787918c6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:39.579237 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:39.582912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:39.623544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27a3d1-44d0-457f-ba46-717ac29f9f07 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:39.821608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:39.824523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:39.854945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:39.856219 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:39.856636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:39.862681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] PATH_INFO: `/v3/projects/0ada7b3c140545e7b6ee9a76f092e624` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:39.865630 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ada7b3c140545e7b6ee9a76f092e624)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:39.880012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:39.892570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbb6b8-5c4d-47dd-9f18-e582f947df5c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:39.909180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:39.916371 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:39.917618 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:39.918542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:39.919050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] PATH_INFO: `/v3/projects/b46a0b2aba534e90b0c741a5d3e47dca` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:39.921272 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46a0b2aba534e90b0c741a5d3e47dca)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:39.931328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:40.121416 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ada7b3c140545e7b6ee9a76f092e624', 'request_id': 'req-5864394a-7d87-48a0-bb25-33bbce57550a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.145895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ada7b3c140545e7b6ee9a76f092e624', 'request_id': 'req-5864394a-7d87-48a0-bb25-33bbce57550a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.158586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46a0b2aba534e90b0c741a5d3e47dca', 'request_id': 'req-0decbd78-89f0-4f96-b8e1-8b36ef504221'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.181581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46a0b2aba534e90b0c741a5d3e47dca', 'request_id': 'req-0decbd78-89f0-4f96-b8e1-8b36ef504221'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.183521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ada7b3c140545e7b6ee9a76f092e624', 'request_id': 'req-5864394a-7d87-48a0-bb25-33bbce57550a'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.203992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46a0b2aba534e90b0c741a5d3e47dca', 'request_id': 'req-0decbd78-89f0-4f96-b8e1-8b36ef504221'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.237120 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] The token cache is being invalidate because project b46a0b2aba534e90b0c741a5d3e47dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:40.238855 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.241427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.246898 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1207/2388] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:39 2022] DELETE /identity/v3/projects/b46a0b2aba534e90b0c741a5d3e47dca => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:40.273052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:40.274285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] The token cache is being invalidate because project 0ada7b3c140545e7b6ee9a76f092e624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:40.274912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:40.276741 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.279496 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-5864394a-7d87-48a0-bb25-33bbce57550a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.287873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1182/2389] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:39 2022] DELETE /identity/v3/projects/0ada7b3c140545e7b6ee9a76f092e624 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:40.297299 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53be2c-52d7-4517-aeb3-6e3c24e1f3a2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:40.298199 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53be2c-52d7-4517-aeb3-6e3c24e1f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:40.298996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53be2c-52d7-4517-aeb3-6e3c24e1f3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:40.359493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:40.426532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-cd53be2c-52d7-4517-aeb3-6e3c24e1f3a2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:40.433598 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cd53be2c-52d7-4517-aeb3-6e3c24e1f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:40.485423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decbd78-89f0-4f96-b8e1-8b36ef504221 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:40.499424 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:40.500157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:40.500441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:40.500718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] PATH_INFO: `/v3/projects/5570bc291345423192fc3eb0dcc18a80` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:40.502395 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5570bc291345423192fc3eb0dcc18a80)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:40.517018 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:40.651194 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5570bc291345423192fc3eb0dcc18a80', 'request_id': 'req-1e8f33b5-1311-4a7d-9014-95ec358514c7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.665998 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5570bc291345423192fc3eb0dcc18a80', 'request_id': 'req-1e8f33b5-1311-4a7d-9014-95ec358514c7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.687754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5570bc291345423192fc3eb0dcc18a80', 'request_id': 'req-1e8f33b5-1311-4a7d-9014-95ec358514c7'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.723513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] The token cache is being invalidate because project 5570bc291345423192fc3eb0dcc18a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:40.723815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.725159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-1e8f33b5-1311-4a7d-9014-95ec358514c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:40.727688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1208/2390] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:40 2022] DELETE /identity/v3/projects/5570bc291345423192fc3eb0dcc18a80 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:40.734497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435d95-9dc4-45e1-90f8-4b05de2ac1d8 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:40.735556 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435d95-9dc4-45e1-90f8-4b05de2ac1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:40.736478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435d95-9dc4-45e1-90f8-4b05de2ac1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:40.752091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1183/2391] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:40.765554 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d98352-e027-4284-b051-1429411fc084 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:40.766207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d98352-e027-4284-b051-1429411fc084 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:40.766723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d98352-e027-4284-b051-1429411fc084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:40.799014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-ae435d95-9dc4-45e1-90f8-4b05de2ac1d8 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:40.801327 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ae435d95-9dc4-45e1-90f8-4b05de2ac1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:40.826041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-17d98352-e027-4284-b051-1429411fc084 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:40.832852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-17d98352-e027-4284-b051-1429411fc084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:40.953498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1209/2392] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:40.954471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1184/2393] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:40.959073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435d95-9dc4-45e1-90f8-4b05de2ac1d8 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:40.968694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaf767-9c89-4aa3-8b1b-4a72580c77df None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:40.969245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaf767-9c89-4aa3-8b1b-4a72580c77df None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:40.969617 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaf767-9c89-4aa3-8b1b-4a72580c77df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:40.974279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae435d95-9dc4-45e1-90f8-4b05de2ac1d8 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:40.985820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:40.986987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:40.987493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:40.987911 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:40.988834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:40.989391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:40.992140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.017452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1210/2394] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:07:41.022594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.032068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-bcaaf767-9c89-4aa3-8b1b-4a72580c77df None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:41.034454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-bcaaf767-9c89-4aa3-8b1b-4a72580c77df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:41.040026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06402f-34df-41e6-ab2b-85fbb7b4d82f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.048528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.050055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.053264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.054268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.056285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.060328 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.060852 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1185/2395] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:41.065205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaf767-9c89-4aa3-8b1b-4a72580c77df None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.086440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaf767-9c89-4aa3-8b1b-4a72580c77df None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.100063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.101157 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.101369 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.101727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.102701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:41.103131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.105086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.127763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1211/2396] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:41 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:41.132799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.135830 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1186/2397] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:41.138031 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.156584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f445f2e-24a2-4e8d-8c03-3498c01c6292 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.170996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:41.176540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:41.299801 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.301121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.301121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.301550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.302418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.304879 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.306874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe8bc5-56a7-406d-96ed-f8c01a705294 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.316314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.317296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.319559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.320053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.323380 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.325486 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.362222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1212/2398] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:41 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:41.363592 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.365414 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1187/2399] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:41 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:41.372399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.375786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaea04d-ba7e-4cb6-aff9-696f88354f1c admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.467297 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90e88c-8724-4800-9329-dca988702c48 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.473493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.474401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.474736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.475044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.475972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.478317 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.489184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.490195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.490927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.491410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.492918 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.496782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.512445 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1188/2400] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:41 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:41.518692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.526924 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1213/2401] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:41.532099 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.541742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b0193-fe05-479e-9563-c43e93b34531 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.554327 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.555345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d4710-3c80-401f-9d21-0be777459904 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.556308 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.557154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.557844 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.561607 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.565939 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.567106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.567808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.568443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.569668 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.570734 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.573233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.600247 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1214/2402] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:41.602768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1189/2403] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:41.603151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.604840 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.623717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec2386-046a-44c1-bbbc-29750a5603ce admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.624367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884504f-a185-45c8-a69a-ce5b3a82c3a1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.632310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.632966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d361e6e-940c-41c9-8464-c27d72eb1658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.633770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.634207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361e6e-940c-41c9-8464-c27d72eb1658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.634425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.634868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361e6e-940c-41c9-8464-c27d72eb1658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.635213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.635418 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d361e6e-940c-41c9-8464-c27d72eb1658 admin admin] PATH_INFO: `/v3/projects/8da34d406be14a2297365e3229e741db/users/a8cf5aed03ae417891a3be63cd635550/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.636692 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.640337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.669595 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1215/2404] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:41.671797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:41.675966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d361e6e-940c-41c9-8464-c27d72eb1658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da34d406be14a2297365e3229e741db, user_id=a8cf5aed03ae417891a3be63cd635550, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.682604 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d361e6e-940c-41c9-8464-c27d72eb1658 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.699615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b0a11-df57-477c-afea-604db4f871e3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:41.712330 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1190/2405] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:41 2022] PUT /identity/v3/projects/8da34d406be14a2297365e3229e741db/users/a8cf5aed03ae417891a3be63cd635550/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:41.751633 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce0aa-294e-4f97-b891-5c3f7e7b7bb2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.752083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce0aa-294e-4f97-b891-5c3f7e7b7bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.752751 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ce0aa-294e-4f97-b891-5c3f7e7b7bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.822815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-e42ce0aa-294e-4f97-b891-5c3f7e7b7bb2 None None] MFA Rules not processed for user `a8cf5aed03ae417891a3be63cd635550`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:41.825454 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-e42ce0aa-294e-4f97-b891-5c3f7e7b7bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:41.848771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60eaa-d9f9-4f76-a4a3-395146b0cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:41.849919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60eaa-d9f9-4f76-a4a3-395146b0cf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.850808 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60eaa-d9f9-4f76-a4a3-395146b0cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.850962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60eaa-d9f9-4f76-a4a3-395146b0cf20 admin admin] PATH_INFO: `/v3/projects/61aea9d0a3e74263b8909d9088409c4e/users/41f1466f94ca4a3eae4934f536077dad/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:41.882044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60eaa-d9f9-4f76-a4a3-395146b0cf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61aea9d0a3e74263b8909d9088409c4e, user_id=41f1466f94ca4a3eae4934f536077dad, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:41.886669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b60eaa-d9f9-4f76-a4a3-395146b0cf20 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:41.919462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:41.956839 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1216/2406] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:41 2022] PUT /identity/v3/projects/61aea9d0a3e74263b8909d9088409c4e/users/41f1466f94ca4a3eae4934f536077dad/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:41.960874 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb80a63-b688-4c0a-8064-3e8989006c81 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:41.963849 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb80a63-b688-4c0a-8064-3e8989006c81 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:41.964176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb80a63-b688-4c0a-8064-3e8989006c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.013509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:42.054276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1fb80a63-b688-4c0a-8064-3e8989006c81 None None] MFA Rules not processed for user `41f1466f94ca4a3eae4934f536077dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:42.055938 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1fb80a63-b688-4c0a-8064-3e8989006c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:42.133996 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1191/2407] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:42.147243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce0aa-294e-4f97-b891-5c3f7e7b7bb2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:42.176321 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ce0aa-294e-4f97-b891-5c3f7e7b7bb2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:42.219714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1217/2408] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:42.226208 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb80a63-b688-4c0a-8064-3e8989006c81 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:42.275344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:42.276262 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:42.276542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:42.276871 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.277621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:42.281218 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:42.339132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1192/2409] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:42 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:42.347309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:42.403992 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb80a63-b688-4c0a-8064-3e8989006c81 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:42.515640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad19e4d-6a69-4eec-adbc-e4ff6d056cec admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:42.525504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:42.526839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:42.527424 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:42.527984 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.529240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:42.534331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:42.562325 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:42.566667 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:42.567258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:42.567885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.569233 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:42.571426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:42.590906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1193/2410] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:42 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:42.593694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:42.636359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1218/2411] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:42 2022] POST /identity/v3/projects => generated 383 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:42.640270 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3a7e9-fc0c-4c22-a9fa-84208ddbc278 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:42.641986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:42.694873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:42.781471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:42.783336 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:42.783502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:42.783724 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.784568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:42.788326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:42.790183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:42.807990 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e695a7-ac24-46a1-be2f-b57f068c276a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:42.818024 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1194/2412] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:42.819238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:42.820020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:42.820432 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:42.820755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.821615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:42.823508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:42.829659 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:42.837835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7a648-87b5-4c85-aa95-583ae14734e0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:42.869311 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:42.871532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:42.871532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:42.871532 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] PATH_INFO: `/v3/projects/2ff67a95753f4253a4f0fe01464f3f56/users/4a1d01feec3140c8bf3a277347850904/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.899517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1219/2413] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:42 2022] POST /identity/v3/users => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:42.909072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:42.921815 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff67a95753f4253a4f0fe01464f3f56, user_id=4a1d01feec3140c8bf3a277347850904, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:42.938896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bcf77-321b-4abf-9476-e2087f311058 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:42.943880 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:42.967590 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:42.968726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:42.969211 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:42.969680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:42.973582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:42.978866 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:43.031165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1220/2414] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:43.033121 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:43.071330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e00ca-fe4e-474a-91cf-d9aeb5beb719 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:43.097761 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1195/2415] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:42 2022] PUT /identity/v3/projects/2ff67a95753f4253a4f0fe01464f3f56/users/4a1d01feec3140c8bf3a277347850904/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:43.103990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:43.232204 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:43.233006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.233479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.233854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] PATH_INFO: `/v3/projects/b51c2ffb1720444aa1c8adeabae74ce2/users/6ecbd181878148b9acc0d7aae405f264/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.239804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208520c8-c404-40f1-afde-c2d28137b2f8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:43.247534 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:43.248302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.248566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.248831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.249495 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:43.251257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:43.265616 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51c2ffb1720444aa1c8adeabae74ce2, user_id=6ecbd181878148b9acc0d7aae405f264, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:43.271565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1196/2416] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:43.271830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:43.273737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:43.289469 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc0e6e-c624-4874-884d-2ec5df8aa850 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:43.315078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1221/2417] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:43 2022] PUT /identity/v3/projects/b51c2ffb1720444aa1c8adeabae74ce2/users/6ecbd181878148b9acc0d7aae405f264/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:43.317928 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:43.329750 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd157e8-2ce8-4d7d-9de4-f48296caf00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:43.331009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd157e8-2ce8-4d7d-9de4-f48296caf00d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.332692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd157e8-2ce8-4d7d-9de4-f48296caf00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.333189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd157e8-2ce8-4d7d-9de4-f48296caf00d admin admin] PATH_INFO: `/v3/projects/2ff67a95753f4253a4f0fe01464f3f56/users/4a1d01feec3140c8bf3a277347850904/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.346994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd157e8-2ce8-4d7d-9de4-f48296caf00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff67a95753f4253a4f0fe01464f3f56, user_id=4a1d01feec3140c8bf3a277347850904, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:43.362508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd157e8-2ce8-4d7d-9de4-f48296caf00d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:43.409178 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1197/2418] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:43 2022] PUT /identity/v3/projects/2ff67a95753f4253a4f0fe01464f3f56/users/4a1d01feec3140c8bf3a277347850904/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:43.416621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.422248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.426234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.501601 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] MFA Rules not processed for user `4a1d01feec3140c8bf3a277347850904`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:43.504913 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:43.516821 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df41e-6827-4dbf-b22c-dbf890727dc2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:43.578323 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:43.625590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1198/2419] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:43.638513 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:43.640821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:43.647027 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:43.648532 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.649087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.649605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.650594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:43.653642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:43.684243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1222/2420] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:43.708946 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:43.722674 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2170527-f26c-4516-bd4c-898e32fc3238 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:43.729929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09819976-caa8-47f5-9a01-a0474c5bcbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:43.731415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819976-caa8-47f5-9a01-a0474c5bcbab admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.731931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819976-caa8-47f5-9a01-a0474c5bcbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.732466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09819976-caa8-47f5-9a01-a0474c5bcbab admin admin] PATH_INFO: `/v3/projects/b51c2ffb1720444aa1c8adeabae74ce2/users/6ecbd181878148b9acc0d7aae405f264/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.735745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09819976-caa8-47f5-9a01-a0474c5bcbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51c2ffb1720444aa1c8adeabae74ce2, user_id=6ecbd181878148b9acc0d7aae405f264, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:43.739804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09819976-caa8-47f5-9a01-a0474c5bcbab admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:43.757378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1223/2421] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:43 2022] PUT /identity/v3/projects/b51c2ffb1720444aa1c8adeabae74ce2/users/6ecbd181878148b9acc0d7aae405f264/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:43.770127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:43.772054 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.772828 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.773201 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.815657 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0762d6-09a6-4f7a-b99a-371602af7730 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:43.849153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] MFA Rules not processed for user `6ecbd181878148b9acc0d7aae405f264`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:43.852875 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:43.932229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:43.933329 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:43.933803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:43.934264 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:43.992277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1224/2422] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:44.006016 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:44.008421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:44.021726 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16bbb-88ad-4088-b76f-c53d8ff4edd5 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:44.025500 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:44.026115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:44.026384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:44.026671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:44.031353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:44.032843 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:44.037181 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:44.039156 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:44.044552 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1199/2423] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:44.049883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1225/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:44.181698 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:44.196272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0d378-252e-487b-8caf-3906e3fa314f service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:44.201026 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225e30-9f0a-4412-9543-f0926f166c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:44.201681 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225e30-9f0a-4412-9543-f0926f166c5f service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:44.201932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225e30-9f0a-4412-9543-f0926f166c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:44.202200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225e30-9f0a-4412-9543-f0926f166c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:44.281032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6225e30-9f0a-4412-9543-f0926f166c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:44.282655 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6225e30-9f0a-4412-9543-f0926f166c5f service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:44.294132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1200/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:44.550648 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:44.680283 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9c524-49c8-4029-84e8-f3a6017cf4a5 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:44.690339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:44.692362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:44.693629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:44.694522 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] PATH_INFO: `/v3/users/a8cf5aed03ae417891a3be63cd635550` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:44.697516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8cf5aed03ae417891a3be63cd635550)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:44.702422 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:44.747598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:44.791633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8cf5aed03ae417891a3be63cd635550'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:44.792743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8cf5aed03ae417891a3be63cd635550'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:44.806841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8cf5aed03ae417891a3be63cd635550'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:44.822394 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8cf5aed03ae417891a3be63cd635550'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:44.841229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8cf5aed03ae417891a3be63cd635550'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:44.848042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1226/2426] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:44 2022] DELETE /identity/v3/users/a8cf5aed03ae417891a3be63cd635550 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:44.853216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:44.853870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:44.853870 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:44.876149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:44.877403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:44.930941 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:44.970896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1201/2427] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:44.978598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:44.981860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:45.057758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a5247-2850-4e80-9f42-a32cfd859aa4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:45.064215 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:45.065239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:45.065706 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:45.066165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:45.081604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:45.083096 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:45.095591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1227/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:45.403902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:45.405618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:45.419796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23202-28e6-44ef-9327-4d10a8a6eb3d None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:45.425056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:45.425717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:45.425992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:45.426250 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] PATH_INFO: `/v3/projects/8da34d406be14a2297365e3229e741db` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:45.428039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da34d406be14a2297365e3229e741db)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:45.430758 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:45.484518 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da34d406be14a2297365e3229e741db', 'request_id': 'req-0221bb9f-a257-4441-a02c-ec36305ea687'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.490899 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da34d406be14a2297365e3229e741db', 'request_id': 'req-0221bb9f-a257-4441-a02c-ec36305ea687'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.500028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da34d406be14a2297365e3229e741db', 'request_id': 'req-0221bb9f-a257-4441-a02c-ec36305ea687'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.513139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] The token cache is being invalidate because project 8da34d406be14a2297365e3229e741db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:45.513428 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.514082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.516114 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1202/2429] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:45 2022] DELETE /identity/v3/projects/8da34d406be14a2297365e3229e741db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:45.520703 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:45.533979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380cfc9-8001-4a1f-a6bf-d8a9d2e47429 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:45.599835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:45.600630 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:45.600729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:45.600970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] PATH_INFO: `/v3/users/4a1d01feec3140c8bf3a277347850904` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:45.602276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a1d01feec3140c8bf3a277347850904)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:45.604286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:45.663677 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a1d01feec3140c8bf3a277347850904'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.664833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a1d01feec3140c8bf3a277347850904'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.667254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:45.678641 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a1d01feec3140c8bf3a277347850904'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.689051 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a1d01feec3140c8bf3a277347850904'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.704072 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5e090ab9-6cd8-46b2-b4af-c26e9806c3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a1d01feec3140c8bf3a277347850904'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:45.714672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1228/2430] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:45 2022] DELETE /identity/v3/users/4a1d01feec3140c8bf3a277347850904 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:46.084891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:46.087842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:46.109290 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0221bb9f-a257-4441-a02c-ec36305ea687 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:46.223831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:46.224727 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.225234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.225510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] PATH_INFO: `/v3/projects/2ff67a95753f4253a4f0fe01464f3f56` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.226887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff67a95753f4253a4f0fe01464f3f56)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:46.228812 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:46.288412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff67a95753f4253a4f0fe01464f3f56', 'request_id': 'req-2a196e83-ecd4-468b-9de6-df73d3cdaf54'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:46.296173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff67a95753f4253a4f0fe01464f3f56', 'request_id': 'req-2a196e83-ecd4-468b-9de6-df73d3cdaf54'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:46.304060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff67a95753f4253a4f0fe01464f3f56', 'request_id': 'req-2a196e83-ecd4-468b-9de6-df73d3cdaf54'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:46.312426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:46.320156 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] The token cache is being invalidate because project 2ff67a95753f4253a4f0fe01464f3f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:46.320675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:46.321925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-2a196e83-ecd4-468b-9de6-df73d3cdaf54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:46.326490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1203/2431] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:46 2022] DELETE /identity/v3/projects/2ff67a95753f4253a4f0fe01464f3f56 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:46.335369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c477900-4254-4d8f-9a2d-898710221b0e None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.335715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c477900-4254-4d8f-9a2d-898710221b0e None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.336117 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c477900-4254-4d8f-9a2d-898710221b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.358995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3c477900-4254-4d8f-9a2d-898710221b0e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:46.360386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3c477900-4254-4d8f-9a2d-898710221b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:46.434164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1229/2432] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:46.442842 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49946d99-990b-4d80-a4b3-f442f7f56d50 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.443263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49946d99-990b-4d80-a4b3-f442f7f56d50 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.443659 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49946d99-990b-4d80-a4b3-f442f7f56d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.467636 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-49946d99-990b-4d80-a4b3-f442f7f56d50 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:46.468987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-49946d99-990b-4d80-a4b3-f442f7f56d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:46.478645 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1204/2433] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:46.483876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c477900-4254-4d8f-9a2d-898710221b0e None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:46.495621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c477900-4254-4d8f-9a2d-898710221b0e None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:46.500475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:46.501106 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.501384 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.501679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.502346 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:46.502683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:46.504312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:46.519131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1230/2434] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:46.524968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49946d99-990b-4d80-a4b3-f442f7f56d50 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:46.541251 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49946d99-990b-4d80-a4b3-f442f7f56d50 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:46.548380 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:46.549333 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.549810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.550272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.551300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:46.554765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:46.601234 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1205/2435] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:46 2022] POST /identity/v3/projects => generated 407 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:46.606148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:46.617815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2df4-6452-4d62-90e8-6150f2628ca3 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:46.693212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:46.693764 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.694224 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.694493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.695187 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:46.697157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:46.720469 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1231/2436] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:46 2022] POST /identity/v3/users => generated 304 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:46.725185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:46.736994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa202d9-7bae-47d2-aae2-f833a48ed840 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:46.742997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:46.743639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.743923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.744188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.744837 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:46.746516 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:46.758172 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1206/2437] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:46.762125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:46.773599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70192b-d41a-4d1a-8768-b1a669b78b0a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:46.778680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56869a05-211a-4b41-8146-39dd9b604171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:46.779296 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869a05-211a-4b41-8146-39dd9b604171 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.779570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869a05-211a-4b41-8146-39dd9b604171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.779834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869a05-211a-4b41-8146-39dd9b604171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.780444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56869a05-211a-4b41-8146-39dd9b604171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:46.782034 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56869a05-211a-4b41-8146-39dd9b604171 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:46.794254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1232/2438] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:46.798901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:46.809450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784a23-a714-41af-ae38-54673b4befdb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:46.814673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:46.815361 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.815666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.815934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] PATH_INFO: `/v3/projects/3f62094382d14d5cada94de2962dbca6/users/cece05d978354e72b76cff3aec6f1b26/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.833652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f62094382d14d5cada94de2962dbca6, user_id=cece05d978354e72b76cff3aec6f1b26, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:46.836477 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:46.853226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1207/2439] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:46 2022] PUT /identity/v3/projects/3f62094382d14d5cada94de2962dbca6/users/cece05d978354e72b76cff3aec6f1b26/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:46.864376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691503e-4a93-4cbf-8e94-bc1ded400c5d None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:46.864654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691503e-4a93-4cbf-8e94-bc1ded400c5d None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:46.864919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691503e-4a93-4cbf-8e94-bc1ded400c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:46.895487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a691503e-4a93-4cbf-8e94-bc1ded400c5d None None] MFA Rules not processed for user `cece05d978354e72b76cff3aec6f1b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:46.896716 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a691503e-4a93-4cbf-8e94-bc1ded400c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:46.917191 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:46.971445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1233/2440] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:46.976335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.051838 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10caa0-7b7f-4092-990b-85ef0721e6a3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.056767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.057386 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.057664 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.057930 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.058615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.060594 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.091946 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1208/2441] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:46 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:47.096925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691503e-4a93-4cbf-8e94-bc1ded400c5d None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.109708 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691503e-4a93-4cbf-8e94-bc1ded400c5d None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.175163 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.175781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.176050 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.176316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.176941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.179129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.202759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1234/2442] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:47 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:47.207090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.219243 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d554-6e1c-4c60-a925-18e55f95a2d6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.227095 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.228140 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.228610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.229089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.231000 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.232915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.243917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.245925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:47.261101 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6c134-5cbe-4acf-9477-9b1cfbf5456f admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.263686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1209/2443] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:47.268544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.269830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.270584 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.270873 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.271146 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] PATH_INFO: `/v3/users/41f1466f94ca4a3eae4934f536077dad` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.272562 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f1466f94ca4a3eae4934f536077dad)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.274537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.283933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45abec-cb60-48bb-98c9-faa58b1485e5 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.290540 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.291602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.291984 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.292261 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] PATH_INFO: `/v3/projects/0854e451aa2248d29b9d416df061c673/users/334f7eaecc054f4799451fa471f27333/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.316103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0854e451aa2248d29b9d416df061c673, user_id=334f7eaecc054f4799451fa471f27333, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.320578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.342009 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1210/2444] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:47 2022] PUT /identity/v3/projects/0854e451aa2248d29b9d416df061c673/users/334f7eaecc054f4799451fa471f27333/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:47.347153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.347714 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f1466f94ca4a3eae4934f536077dad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:47.348498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f1466f94ca4a3eae4934f536077dad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:47.358959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f1466f94ca4a3eae4934f536077dad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:47.370165 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f1466f94ca4a3eae4934f536077dad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:47.400546 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c0d07b9d-5a58-489e-84bd-831124ba455f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f1466f94ca4a3eae4934f536077dad'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:47.424787 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:47.432244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1235/2445] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:47 2022] DELETE /identity/v3/users/41f1466f94ca4a3eae4934f536077dad => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:47.438178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.438844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.439216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.453196 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ef28-b563-4c3a-9848-5f189c26aefb admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.465318 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:47.466745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:47.492733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:47.554415 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1236/2446] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:47.564383 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.564746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.565561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.565848 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.565979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:47.566151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.566875 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.568642 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.583728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1211/2447] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:47.587980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.591891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:47.604977 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e2574-182c-4458-b072-a65e121bbc29 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.612985 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d35f8d-d726-4b9c-a1af-9683b24dc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.613862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35f8d-d726-4b9c-a1af-9683b24dc3af admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.614144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35f8d-d726-4b9c-a1af-9683b24dc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.614410 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d35f8d-d726-4b9c-a1af-9683b24dc3af admin admin] PATH_INFO: `/v3/projects/0854e451aa2248d29b9d416df061c673/users/334f7eaecc054f4799451fa471f27333/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.616806 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35f8d-d726-4b9c-a1af-9683b24dc3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0854e451aa2248d29b9d416df061c673, user_id=334f7eaecc054f4799451fa471f27333, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.619920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d35f8d-d726-4b9c-a1af-9683b24dc3af admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.634653 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1212/2448] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:47 2022] PUT /identity/v3/projects/0854e451aa2248d29b9d416df061c673/users/334f7eaecc054f4799451fa471f27333/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:47.645091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.645403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.645719 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.648488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14996a4d-b940-4f2b-9e6f-638600ec7c8c None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.684831 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] MFA Rules not processed for user `334f7eaecc054f4799451fa471f27333`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:47.686623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:47.704836 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.705445 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.705713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.706055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.773549 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1213/2449] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:47.774781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.776235 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.784325 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:47.785765 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:47.787418 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1237/2450] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:47.857768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b881-e93b-405d-9a63-e6c83e40dfe9 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:47.861784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:47.862462 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:47.862777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:47.863028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:47.877972 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:47.879934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:47.902777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1214/2451] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:47 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:48.134862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:48.147061 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ac94-be3f-4222-8527-8a5221735667 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:48.156082 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:48.156687 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:48.157491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:48.157491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:48.157491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:48.159689 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:48.159998 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:48.176635 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:48.190007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de84be3-f6b7-439a-9628-41081caa3dad service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:48.198610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:48.199809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:48.200312 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:48.200817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] PATH_INFO: `/v3/projects/61aea9d0a3e74263b8909d9088409c4e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:48.201658 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:48.203132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61aea9d0a3e74263b8909d9088409c4e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:48.206776 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:48.243517 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:48.245428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:48.261900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1238/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:48 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:48.281223 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61aea9d0a3e74263b8909d9088409c4e', 'request_id': 'req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.289866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61aea9d0a3e74263b8909d9088409c4e', 'request_id': 'req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.303013 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61aea9d0a3e74263b8909d9088409c4e', 'request_id': 'req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.316754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] The token cache is being invalidate because project 61aea9d0a3e74263b8909d9088409c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:48.316754 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.317458 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.319359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1215/2453] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:48 2022] DELETE /identity/v3/projects/61aea9d0a3e74263b8909d9088409c4e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:48.326275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:48.347022 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2539a-9df4-4254-b044-0ba57f5d5d66 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:48.429044 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:48.429685 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:48.429963 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:48.430231 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] PATH_INFO: `/v3/users/6ecbd181878148b9acc0d7aae405f264` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:48.431594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ecbd181878148b9acc0d7aae405f264)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:48.433695 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:48.501940 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ecbd181878148b9acc0d7aae405f264'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.502783 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ecbd181878148b9acc0d7aae405f264'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.511999 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ecbd181878148b9acc0d7aae405f264'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.524403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ecbd181878148b9acc0d7aae405f264'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.541834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-101195b8-3804-429e-a646-7ee22d9108e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ecbd181878148b9acc0d7aae405f264'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:48.551491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1239/2454] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:48 2022] DELETE /identity/v3/users/6ecbd181878148b9acc0d7aae405f264 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:48.960508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:48.962062 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:48.985610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4535d7-7b16-43d4-9ec9-df3c077b4ec3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.059202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.059860 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.060144 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.060399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] PATH_INFO: `/v3/projects/b51c2ffb1720444aa1c8adeabae74ce2` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.061618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51c2ffb1720444aa1c8adeabae74ce2)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.063504 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.115063 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51c2ffb1720444aa1c8adeabae74ce2', 'request_id': 'req-9392ebd0-0c90-41b1-a632-0faf96a5f70b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:49.122116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51c2ffb1720444aa1c8adeabae74ce2', 'request_id': 'req-9392ebd0-0c90-41b1-a632-0faf96a5f70b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:49.131658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51c2ffb1720444aa1c8adeabae74ce2', 'request_id': 'req-9392ebd0-0c90-41b1-a632-0faf96a5f70b'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:49.144403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] The token cache is being invalidate because project b51c2ffb1720444aa1c8adeabae74ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:49.144696 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:49.145421 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9392ebd0-0c90-41b1-a632-0faf96a5f70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:49.147198 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1216/2455] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:48 2022] DELETE /identity/v3/projects/b51c2ffb1720444aa1c8adeabae74ce2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:49.152766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa9cfa-c26c-4aed-a6d6-20ede0354323 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.153278 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa9cfa-c26c-4aed-a6d6-20ede0354323 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.153459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa9cfa-c26c-4aed-a6d6-20ede0354323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.175635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-a2fa9cfa-c26c-4aed-a6d6-20ede0354323 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:49.176841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a2fa9cfa-c26c-4aed-a6d6-20ede0354323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:49.220789 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:49.240945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1240/2456] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:49.248983 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac72c-b1e7-4dfb-839f-c80aeb27db1b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.249558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac72c-b1e7-4dfb-839f-c80aeb27db1b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.249558 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac72c-b1e7-4dfb-839f-c80aeb27db1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.271353 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-312ac72c-b1e7-4dfb-839f-c80aeb27db1b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:49.272699 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-312ac72c-b1e7-4dfb-839f-c80aeb27db1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:49.281039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1217/2457] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:49.285720 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa9cfa-c26c-4aed-a6d6-20ede0354323 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.297694 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa9cfa-c26c-4aed-a6d6-20ede0354323 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.303340 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.304158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.304555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.304952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.305710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:49.306048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.308056 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.322725 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1241/2458] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:49.327355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac72c-b1e7-4dfb-839f-c80aeb27db1b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.337658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ac72c-b1e7-4dfb-839f-c80aeb27db1b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.342650 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.343279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.343585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.343820 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.344470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.346383 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.352825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:49.384185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1218/2459] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:49 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:49.385475 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.396302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d12c7-9ed6-423e-882c-9589dd3cb5a6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.476026 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.476686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.476975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.477246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.477896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.479959 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.507594 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1242/2460] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:49 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:49.512154 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.525486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ea708-8868-415d-92a6-04242752f0f7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.531121 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.531746 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.532016 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.532279 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.532932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.534686 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.546867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1219/2461] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:49.551074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.563362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40526b-fb09-4860-8600-38c068eeca86 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.568304 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300a2a-ea1d-4e3f-bdf0-6132c93f1577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.569083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300a2a-ea1d-4e3f-bdf0-6132c93f1577 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.569364 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300a2a-ea1d-4e3f-bdf0-6132c93f1577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.569630 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300a2a-ea1d-4e3f-bdf0-6132c93f1577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.570281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300a2a-ea1d-4e3f-bdf0-6132c93f1577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.571923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300a2a-ea1d-4e3f-bdf0-6132c93f1577 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.583845 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1243/2462] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:49.588101 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.598753 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a50a2c-6b5a-4148-a983-e580cea13bf0 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.603658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.604309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.604582 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.604849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] PATH_INFO: `/v3/projects/389079229df7467eb48bd1dfef2d1479/users/5c22a751cccf44f0bde29d5dbe18183e/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.622694 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389079229df7467eb48bd1dfef2d1479, user_id=5c22a751cccf44f0bde29d5dbe18183e, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.625855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.640845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1220/2463] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:49 2022] PUT /identity/v3/projects/389079229df7467eb48bd1dfef2d1479/users/5c22a751cccf44f0bde29d5dbe18183e/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:49.651302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb7a1-aac0-4214-9838-9a5b6066466f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.651623 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb7a1-aac0-4214-9838-9a5b6066466f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.651896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb7a1-aac0-4214-9838-9a5b6066466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.686474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-164eb7a1-aac0-4214-9838-9a5b6066466f None None] MFA Rules not processed for user `5c22a751cccf44f0bde29d5dbe18183e`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:49.687830 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-164eb7a1-aac0-4214-9838-9a5b6066466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:49.758083 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1244/2464] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:49.762669 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.835379 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4730fd-22f4-4c54-b077-4aeec13e4077 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.840179 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.840795 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.841073 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.841340 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.842012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.843984 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:49.877691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1221/2465] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:49 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:49.881597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eb7a1-aac0-4214-9838-9a5b6066466f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:49.894344 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eb7a1-aac0-4214-9838-9a5b6066466f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:49.954151 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:49.972516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:49.973139 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:49.978643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:49.978643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:49.978643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:49.978643 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:50.003493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1245/2466] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:49 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:50.004829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:50.017329 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b092a30-61d1-4a06-924c-66b33f517e85 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:50.023320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:50.023951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:50.024229 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:50.024647 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:50.025150 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:50.026863 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:50.042109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1222/2467] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:50.043559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:50.054900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7398c5-1826-45ff-8e86-56883d5988e9 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:50.059991 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:50.060652 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:50.060957 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:50.061225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] PATH_INFO: `/v3/projects/1cf6370ec34043fd9e6f2305607a15ef/users/026a4cd3e85540eab28eec2bcc972de5/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:50.076661 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf6370ec34043fd9e6f2305607a15ef, user_id=026a4cd3e85540eab28eec2bcc972de5, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:50.079381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:50.097262 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1246/2468] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:50 2022] PUT /identity/v3/projects/1cf6370ec34043fd9e6f2305607a15ef/users/026a4cd3e85540eab28eec2bcc972de5/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:50.103331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:50.119514 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a360-4344-465d-bb85-b431ed67974b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:50.188608 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0b1b3-2b13-4c55-910b-fa67de499927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:50.189217 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0b1b3-2b13-4c55-910b-fa67de499927 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:50.189488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0b1b3-2b13-4c55-910b-fa67de499927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:50.189752 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0b1b3-2b13-4c55-910b-fa67de499927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:50.190392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0b1b3-2b13-4c55-910b-fa67de499927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:50.192015 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0b1b3-2b13-4c55-910b-fa67de499927 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:50.202260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1223/2469] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:50.208419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:50.219691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2767e6-c160-4b3c-b97a-63b25ef5d46a admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:50.225827 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:50.226489 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:50.226824 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:50.227078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] PATH_INFO: `/v3/projects/1cf6370ec34043fd9e6f2305607a15ef/users/026a4cd3e85540eab28eec2bcc972de5/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:50.229462 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf6370ec34043fd9e6f2305607a15ef, user_id=026a4cd3e85540eab28eec2bcc972de5, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:50.232325 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:50.243986 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1247/2470] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:50 2022] PUT /identity/v3/projects/1cf6370ec34043fd9e6f2305607a15ef/users/026a4cd3e85540eab28eec2bcc972de5/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:50.256662 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb334e-0dc0-4aea-a34f-c4fa168ce650 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:50.257200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb334e-0dc0-4aea-a34f-c4fa168ce650 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:50.257200 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb334e-0dc0-4aea-a34f-c4fa168ce650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:50.287570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-0bfb334e-0dc0-4aea-a34f-c4fa168ce650 None None] MFA Rules not processed for user `026a4cd3e85540eab28eec2bcc972de5`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:50.288808 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0bfb334e-0dc0-4aea-a34f-c4fa168ce650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:50.298910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:50.381089 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1224/2471] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:50.393869 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:50.396108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:50.457494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a5586-3911-45a0-a05a-ec2c34d32b71 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:50.461745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:50.462352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:50.462669 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:50.462929 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:50.472717 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:50.474172 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:50.484359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1248/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:50.568231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb334e-0dc0-4aea-a34f-c4fa168ce650 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:50.578881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb334e-0dc0-4aea-a34f-c4fa168ce650 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:50.582951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec24d6-5de2-4db3-aaaf-a346b110b12a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:50.583631 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec24d6-5de2-4db3-aaaf-a346b110b12a service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:50.583839 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec24d6-5de2-4db3-aaaf-a346b110b12a service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:50.584086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec24d6-5de2-4db3-aaaf-a346b110b12a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:50.675003 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec24d6-5de2-4db3-aaaf-a346b110b12a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:50.676588 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec24d6-5de2-4db3-aaaf-a346b110b12a service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:50.688736 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1225/2473] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:50.999192 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:51.093773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8adea-2d15-459d-a79f-e6546ca205ec service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:51.101800 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:51.102513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:51.103006 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:51.103440 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] PATH_INFO: `/v3/users/5c22a751cccf44f0bde29d5dbe18183e` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:51.104979 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c22a751cccf44f0bde29d5dbe18183e)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:51.106817 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:51.170997 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:51.182338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c22a751cccf44f0bde29d5dbe18183e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.183465 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c22a751cccf44f0bde29d5dbe18183e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.191920 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c22a751cccf44f0bde29d5dbe18183e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.206038 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c22a751cccf44f0bde29d5dbe18183e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.230950 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c22a751cccf44f0bde29d5dbe18183e'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.239030 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1249/2474] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:50 2022] DELETE /identity/v3/users/5c22a751cccf44f0bde29d5dbe18183e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:51.244717 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:51.245889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:51.245889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:51.283078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:51.283078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:51.369474 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1226/2475] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:51.380166 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:51.381876 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:51.451621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc4453-2348-4f2b-b19b-024442d9033e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:51.456548 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:51.457222 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:51.457496 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:51.457768 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:51.470254 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:51.472763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:51.485989 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1250/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:51.789770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:51.791536 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:51.807068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d9a0e-b221-41b1-8661-c09774c8fec2 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:51.814235 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:51.815351 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:51.816070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:51.816728 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] PATH_INFO: `/v3/projects/389079229df7467eb48bd1dfef2d1479` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:51.819584 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389079229df7467eb48bd1dfef2d1479)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:51.821680 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:51.871829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:51.882471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389079229df7467eb48bd1dfef2d1479', 'request_id': 'req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.888959 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389079229df7467eb48bd1dfef2d1479', 'request_id': 'req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.899468 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389079229df7467eb48bd1dfef2d1479', 'request_id': 'req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.914373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] The token cache is being invalidate because project 389079229df7467eb48bd1dfef2d1479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:51.914692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.915425 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:51.916997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1227/2477] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:51 2022] DELETE /identity/v3/projects/389079229df7467eb48bd1dfef2d1479 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:51.922312 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:51.933189 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1d5f9-2a5f-42d9-b7e6-7d0a12908cc8 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:52.000542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:52.001243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.001463 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.001730 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] PATH_INFO: `/v3/users/026a4cd3e85540eab28eec2bcc972de5` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.002905 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026a4cd3e85540eab28eec2bcc972de5)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:52.004835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:52.054696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026a4cd3e85540eab28eec2bcc972de5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.055427 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026a4cd3e85540eab28eec2bcc972de5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.062823 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026a4cd3e85540eab28eec2bcc972de5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.066410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:52.071425 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026a4cd3e85540eab28eec2bcc972de5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.086852 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c528e396-8992-4fe8-b001-e69f510ba9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026a4cd3e85540eab28eec2bcc972de5'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.093164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1251/2478] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:51 2022] DELETE /identity/v3/users/026a4cd3e85540eab28eec2bcc972de5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:52.399112 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:52.400716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:52.415049 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e76e08-ecbd-46b1-b1a8-a1ffccd69939 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:52.479640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:52.480248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.480508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.480796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] PATH_INFO: `/v3/projects/1cf6370ec34043fd9e6f2305607a15ef` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.482106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf6370ec34043fd9e6f2305607a15ef)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:52.484689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:52.535999 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf6370ec34043fd9e6f2305607a15ef', 'request_id': 'req-9143f945-b31f-4a69-a07c-37d3a304eabf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.542405 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf6370ec34043fd9e6f2305607a15ef', 'request_id': 'req-9143f945-b31f-4a69-a07c-37d3a304eabf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.551352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf6370ec34043fd9e6f2305607a15ef', 'request_id': 'req-9143f945-b31f-4a69-a07c-37d3a304eabf'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.563169 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] The token cache is being invalidate because project 1cf6370ec34043fd9e6f2305607a15ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:52.563574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.564439 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-9143f945-b31f-4a69-a07c-37d3a304eabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:52.566315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1228/2479] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:52 2022] DELETE /identity/v3/projects/1cf6370ec34043fd9e6f2305607a15ef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:52.571608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa89213-ed5d-4963-9002-dc46322ad781 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.572169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa89213-ed5d-4963-9002-dc46322ad781 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.572169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa89213-ed5d-4963-9002-dc46322ad781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.592199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-7aa89213-ed5d-4963-9002-dc46322ad781 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:52.593393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7aa89213-ed5d-4963-9002-dc46322ad781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:52.670709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1252/2480] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:52.681796 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dfe68-dbf2-4d12-871a-1b1ed43d3941 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.682231 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dfe68-dbf2-4d12-871a-1b1ed43d3941 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.682612 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dfe68-dbf2-4d12-871a-1b1ed43d3941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.708122 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-324dfe68-dbf2-4d12-871a-1b1ed43d3941 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:52.709550 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-324dfe68-dbf2-4d12-871a-1b1ed43d3941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:52.721230 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1229/2481] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:52.726221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa89213-ed5d-4963-9002-dc46322ad781 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:52.737505 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa89213-ed5d-4963-9002-dc46322ad781 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:52.742160 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:52.742804 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.743085 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.743354 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.744088 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:52.744386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:52.745980 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:52.762609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1253/2482] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:52.764139 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dfe68-dbf2-4d12-871a-1b1ed43d3941 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:52.775494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dfe68-dbf2-4d12-871a-1b1ed43d3941 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:52.780337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:52.780961 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.781241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.781510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.782161 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:52.784132 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:52.813126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1230/2483] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:52 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:52.817488 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:52.828446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d6a6b-9869-4463-9ace-1831949aff45 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:52.888576 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:52.889188 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.889464 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.889734 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.890381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:52.892359 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:52.915535 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1254/2484] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:52 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:52.920056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:52.930868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab59258-549b-4e83-b940-9c7994e8f07b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:52.935965 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:52.936570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.936809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.937100 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.937723 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:52.939412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:52.952992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1231/2485] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:52.958271 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:52.969498 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242a804-f6b9-44d9-815f-1416d503a4eb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:52.975133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e4f95-81d4-44c9-ad38-7991d18d0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:52.975805 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e4f95-81d4-44c9-ad38-7991d18d0fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:52.976110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e4f95-81d4-44c9-ad38-7991d18d0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:52.976378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e4f95-81d4-44c9-ad38-7991d18d0fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:52.977729 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e4f95-81d4-44c9-ad38-7991d18d0fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:52.979199 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e4f95-81d4-44c9-ad38-7991d18d0fd8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:52.991609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1255/2486] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:52.996106 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:53.007032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b1fd9-3c41-4135-9bd5-e49d708c6996 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:53.012281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:53.013005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:53.013280 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:53.013549 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] PATH_INFO: `/v3/projects/04ae44997a024ac7a355653b17b26195/users/3aa3ca63d7a048e780a8107553534cea/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:53.030816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ae44997a024ac7a355653b17b26195, user_id=3aa3ca63d7a048e780a8107553534cea, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:53.033619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:53.037566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:53.052411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1232/2487] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:52 2022] PUT /identity/v3/projects/04ae44997a024ac7a355653b17b26195/users/3aa3ca63d7a048e780a8107553534cea/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:53.063350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3463d-186e-4810-af17-9f68ac987ece None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:53.063655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3463d-186e-4810-af17-9f68ac987ece None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:53.064015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3463d-186e-4810-af17-9f68ac987ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:53.094625 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-6aa3463d-186e-4810-af17-9f68ac987ece None None] MFA Rules not processed for user `3aa3ca63d7a048e780a8107553534cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:53.095842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6aa3463d-186e-4810-af17-9f68ac987ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:53.139951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:53.181654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1256/2488] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:53.195310 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:53.197215 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:53.261146 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dedd6-2d97-4a94-99f9-0bbfac5bcf4c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:53.264920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d82484-f6b2-4b2f-b7ce-ffafc5e352b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:53.265542 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82484-f6b2-4b2f-b7ce-ffafc5e352b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:53.265817 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82484-f6b2-4b2f-b7ce-ffafc5e352b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:53.266081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d82484-f6b2-4b2f-b7ce-ffafc5e352b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:53.275691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d82484-f6b2-4b2f-b7ce-ffafc5e352b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:53.277208 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d82484-f6b2-4b2f-b7ce-ffafc5e352b3 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:53.287397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1233/2489] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:53.310493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3463d-186e-4810-af17-9f68ac987ece None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:53.391025 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3463d-186e-4810-af17-9f68ac987ece None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:53.398970 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:53.400010 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:53.400459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:53.400912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] PATH_INFO: `/v3/users/3aa3ca63d7a048e780a8107553534cea` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:53.403045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa3ca63d7a048e780a8107553534cea)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:53.413799 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:53.466116 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa3ca63d7a048e780a8107553534cea'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:53.466843 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa3ca63d7a048e780a8107553534cea'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:53.475421 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa3ca63d7a048e780a8107553534cea'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:53.487203 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa3ca63d7a048e780a8107553534cea'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:53.502962 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa3ca63d7a048e780a8107553534cea'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:53.510651 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1257/2490] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:53 2022] DELETE /identity/v3/users/3aa3ca63d7a048e780a8107553534cea => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:53.515275 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:53.515763 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:53.515858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:53.538412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:53.540335 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:53.609120 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1234/2491] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:53.619515 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:53.620996 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:53.688372 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099b444-fd46-4815-ab5b-1546c0e23062 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:53.692647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139c8d5-d70b-4cec-92b3-3cf9e637aa50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:53.693494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c8d5-d70b-4cec-92b3-3cf9e637aa50 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:53.693848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c8d5-d70b-4cec-92b3-3cf9e637aa50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:53.694042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139c8d5-d70b-4cec-92b3-3cf9e637aa50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:53.702758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:53.708159 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139c8d5-d70b-4cec-92b3-3cf9e637aa50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:53.711183 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139c8d5-d70b-4cec-92b3-3cf9e637aa50 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:53.726079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1258/2492] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:53.878497 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:53.880359 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:53.895757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0510f-354d-42d3-bd01-1726b3f16049 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:53.902819 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:53.904577 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:53.904945 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:53.905902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] PATH_INFO: `/v3/users/cece05d978354e72b76cff3aec6f1b26` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:53.910331 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cece05d978354e72b76cff3aec6f1b26)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:53.912615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.010627 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cece05d978354e72b76cff3aec6f1b26'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.011565 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cece05d978354e72b76cff3aec6f1b26'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.030226 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cece05d978354e72b76cff3aec6f1b26'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.040182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cece05d978354e72b76cff3aec6f1b26'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.041640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cece05d978354e72b76cff3aec6f1b26'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.058523 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1235/2493] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:53 2022] DELETE /identity/v3/users/cece05d978354e72b76cff3aec6f1b26 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:54.063184 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.063529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.063968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.092902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.094362 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.096202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:54.098607 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.111966 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:54.178249 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e98fa-7907-468f-8773-16b6f0aacf9d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.183154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1259/2494] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:54.183346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.183931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.184212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.184891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] PATH_INFO: `/v3/projects/04ae44997a024ac7a355653b17b26195` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.186155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ae44997a024ac7a355653b17b26195)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.188679 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.195035 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.196558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.243107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ae44997a024ac7a355653b17b26195', 'request_id': 'req-a1a8531d-0274-45e7-aa0f-344410445a9c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.250788 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ae44997a024ac7a355653b17b26195', 'request_id': 'req-a1a8531d-0274-45e7-aa0f-344410445a9c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.259413 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ae44997a024ac7a355653b17b26195', 'request_id': 'req-a1a8531d-0274-45e7-aa0f-344410445a9c'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.262927 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba7955-7a96-4b77-a92f-c9e1f3fdf77b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.271715 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] The token cache is being invalidate because project 04ae44997a024ac7a355653b17b26195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:54.272505 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.272725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-a1a8531d-0274-45e7-aa0f-344410445a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.274464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1236/2495] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:54 2022] DELETE /identity/v3/projects/04ae44997a024ac7a355653b17b26195 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:54.279632 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2adf6-29ab-4594-84d2-0b0d8c394668 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.279821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2adf6-29ab-4594-84d2-0b0d8c394668 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.280086 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2adf6-29ab-4594-84d2-0b0d8c394668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.300910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-dfe2adf6-29ab-4594-84d2-0b0d8c394668 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:54.302119 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-dfe2adf6-29ab-4594-84d2-0b0d8c394668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.319310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.319833 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.320103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.320368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.322299 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.367029 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1237/2496] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:54.376123 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87193-7c96-4b69-b55c-8ff59f2b3940 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.376404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87193-7c96-4b69-b55c-8ff59f2b3940 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.376672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87193-7c96-4b69-b55c-8ff59f2b3940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.391684 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.391923 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.397637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5cf87193-7c96-4b69-b55c-8ff59f2b3940 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:54.398922 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5cf87193-7c96-4b69-b55c-8ff59f2b3940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.402521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1260/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:54.407791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1238/2498] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:54.414144 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.419514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:54.429802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbc4be-3d46-4aed-809e-c028b719e5a8 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.434696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.435315 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.435593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.435856 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.436513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:54.436814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.438423 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.451077 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1261/2499] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:07:54.455960 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf87193-7c96-4b69-b55c-8ff59f2b3940 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.466397 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf87193-7c96-4b69-b55c-8ff59f2b3940 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.471420 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.471969 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.472240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.472641 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.473278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.475260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.503901 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1239/2500] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:54.508182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.519069 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07434b7a-4888-4012-a13f-c3877578d523 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.583815 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.585225 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.585599 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.585868 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.586597 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.588781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.615259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1262/2501] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:54.617131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.629926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b37e-0369-4455-bee5-be4129934222 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.635394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.636126 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.636471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.636809 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.637568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.639375 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.651152 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1240/2502] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:54.655506 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.667660 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16f9b3-3c43-4d00-b52a-8e0d5e34574d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.673591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.674396 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.674788 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.675059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.675797 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.677510 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.692277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1263/2503] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:54.697272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.702990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:54.707306 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.709267 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.715320 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19254d-9ad3-4674-a167-fa46def3ede1 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.722358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2af7b-ff7c-4e31-9570-61a7a598ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.724153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28dac8-6d6a-4764-8d3d-99edf8a38e23 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.724309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2af7b-ff7c-4e31-9570-61a7a598ef43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.724567 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2af7b-ff7c-4e31-9570-61a7a598ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.724923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2af7b-ff7c-4e31-9570-61a7a598ef43 admin admin] PATH_INFO: `/v3/projects/52848c5ff79a4fd88ecd62635f245a7c/users/9d354d9f209a4fdca511b4d41ac09774/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.729603 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.730256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.730528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.730814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] PATH_INFO: `/v3/projects/3f62094382d14d5cada94de2962dbca6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.732154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f62094382d14d5cada94de2962dbca6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.734094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.750214 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2af7b-ff7c-4e31-9570-61a7a598ef43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52848c5ff79a4fd88ecd62635f245a7c, user_id=9d354d9f209a4fdca511b4d41ac09774, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.752885 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2af7b-ff7c-4e31-9570-61a7a598ef43 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.769372 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1241/2504] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:54 2022] PUT /identity/v3/projects/52848c5ff79a4fd88ecd62635f245a7c/users/9d354d9f209a4fdca511b4d41ac09774/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:07:54.781145 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77914038-774a-4df8-b903-93f7760e65bf None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.781586 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77914038-774a-4df8-b903-93f7760e65bf None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.782131 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77914038-774a-4df8-b903-93f7760e65bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.793518 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f62094382d14d5cada94de2962dbca6', 'request_id': 'req-6befc40a-a96d-4e3e-91cd-50d132ac9948'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.800239 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f62094382d14d5cada94de2962dbca6', 'request_id': 'req-6befc40a-a96d-4e3e-91cd-50d132ac9948'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.808987 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f62094382d14d5cada94de2962dbca6', 'request_id': 'req-6befc40a-a96d-4e3e-91cd-50d132ac9948'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.815137 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-77914038-774a-4df8-b903-93f7760e65bf None None] MFA Rules not processed for user `9d354d9f209a4fdca511b4d41ac09774`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:54.816498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-77914038-774a-4df8-b903-93f7760e65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.820781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] The token cache is being invalidate because project 3f62094382d14d5cada94de2962dbca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:54.821059 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.821715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.823277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1264/2505] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:54 2022] DELETE /identity/v3/projects/3f62094382d14d5cada94de2962dbca6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:54.827126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.828683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.886699 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:54.892307 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1242/2506] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:54.897183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77914038-774a-4df8-b903-93f7760e65bf None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:54.898503 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-77914038-774a-4df8-b903-93f7760e65bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:54.913020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befc40a-a96d-4e3e-91cd-50d132ac9948 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.918433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.919114 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.919389 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.919654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] PATH_INFO: `/v3/users/334f7eaecc054f4799451fa471f27333` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.920818 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=334f7eaecc054f4799451fa471f27333)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.922978 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.925618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77914038-774a-4df8-b903-93f7760e65bf None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:54.931148 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:54.931771 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:54.932043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:54.932309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:54.932951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:54.935162 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:54.985795 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334f7eaecc054f4799451fa471f27333'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.987058 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334f7eaecc054f4799451fa471f27333'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:54.994182 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1243/2507] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:54.995269 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.001482 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334f7eaecc054f4799451fa471f27333'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.010822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334f7eaecc054f4799451fa471f27333'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.039673 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334f7eaecc054f4799451fa471f27333'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.050220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1265/2508] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:07:54 2022] DELETE /identity/v3/users/334f7eaecc054f4799451fa471f27333 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:55.134136 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:55.160316 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88642135-de33-411f-b38c-aae3d52d2ced admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.235845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.236527 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.236867 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.237077 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.237869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.239997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.267091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1244/2509] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:54 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:55.271279 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.272982 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:55.333330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7d2fb-6577-4ce3-9b59-2d8303983ee1 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.339086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.339713 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.339952 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.340376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.341035 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.342738 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.353620 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1266/2510] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:55.354368 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.356520 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:55.357369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.368345 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1cae1-746d-442f-9f3c-3913337294b8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.373216 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.373819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.374087 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.374350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.375029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.376604 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.378834 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98466668-9fbf-4d4a-9afd-70b5e0fabdf2 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.386740 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.387881 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1267/2511] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:55.391498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.391833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.392149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] PATH_INFO: `/v3/projects/0854e451aa2248d29b9d416df061c673` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.392246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.393654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0854e451aa2248d29b9d416df061c673)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.395769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.406844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fb917-0865-4d58-b5e4-99edb6a952a6 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.414376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b852542-033a-4eca-811b-03911f32a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.415378 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852542-033a-4eca-811b-03911f32a0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.415861 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852542-033a-4eca-811b-03911f32a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.416393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b852542-033a-4eca-811b-03911f32a0b6 admin admin] PATH_INFO: `/v3/projects/24a2f31de7c342238f18a8ec83ebe64b/users/a10a0514bd484eb9b2f885b273ef8689/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.440967 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b852542-033a-4eca-811b-03911f32a0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a2f31de7c342238f18a8ec83ebe64b, user_id=a10a0514bd484eb9b2f885b273ef8689, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.445719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b852542-033a-4eca-811b-03911f32a0b6 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.463362 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1268/2512] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:55 2022] PUT /identity/v3/projects/24a2f31de7c342238f18a8ec83ebe64b/users/a10a0514bd484eb9b2f885b273ef8689/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:55.474035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0854e451aa2248d29b9d416df061c673', 'request_id': 'req-49e99515-4892-48c2-86d5-97b140152dd6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.474035 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0854e451aa2248d29b9d416df061c673', 'request_id': 'req-49e99515-4892-48c2-86d5-97b140152dd6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.476443 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.476719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.477012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.488012 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0854e451aa2248d29b9d416df061c673', 'request_id': 'req-49e99515-4892-48c2-86d5-97b140152dd6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.504050 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] The token cache is being invalidate because project 0854e451aa2248d29b9d416df061c673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:07:55.504347 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.505011 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-49e99515-4892-48c2-86d5-97b140152dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:07:55.507014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1245/2513] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:07:55 2022] DELETE /identity/v3/projects/0854e451aa2248d29b9d416df061c673 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:55.509108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] MFA Rules not processed for user `a10a0514bd484eb9b2f885b273ef8689`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:55.510311 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:55.511964 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb47e0-7ac8-495b-9d52-218d55903004 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.512228 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb47e0-7ac8-495b-9d52-218d55903004 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.512494 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb47e0-7ac8-495b-9d52-218d55903004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.566158 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:55.582055 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-7ffb47e0-7ac8-495b-9d52-218d55903004 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:55.583674 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7ffb47e0-7ac8-495b-9d52-218d55903004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:55.604219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1269/2514] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:55.608851 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.610307 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:55.622510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:55.664720 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1246/2515] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:55.672793 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e72c26-317f-488c-ac1e-76fc439dae07 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.673109 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e72c26-317f-488c-ac1e-76fc439dae07 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.673374 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e72c26-317f-488c-ac1e-76fc439dae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.685316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ad65d-00cf-48c3-bcaa-8b3f76213412 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.691686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.692295 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.692563 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.692822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.693446 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.694789 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-52e72c26-317f-488c-ac1e-76fc439dae07 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:55.695586 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.696001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-52e72c26-317f-488c-ac1e-76fc439dae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:55.704452 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1247/2516] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:55.709115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e72c26-317f-488c-ac1e-76fc439dae07 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.718854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e72c26-317f-488c-ac1e-76fc439dae07 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.724558 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1270/2517] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:55 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:55.727884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.727884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.727884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.727884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.728236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:07:55.728236 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.728722 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.728973 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.742102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1248/2518] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:07:55.746446 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.756718 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd706d-88d4-4c20-8a5e-1f8484207d31 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.796024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61042c9b-d6fb-45f2-aeb1-ffec44096083 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.800894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.801516 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.801790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.802057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.802756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.804681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.819649 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.820285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.820529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.820823 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.821442 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.824039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.828983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1271/2519] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:55 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:55.833127 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.846806 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63023a-b55d-4c29-b952-7e3aa62a4435 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.852671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.853501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.853835 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.854162 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.854985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.855116 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1249/2520] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:07:55 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:07:55.857844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.861043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.871131 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1272/2521] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:07:55.875719 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.886132 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad0bbb-da2c-42fd-85b5-e9787bd1897e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.930655 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:55.931621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042337b-4373-4043-99e9-89f10cd6ed16 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.936620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.937326 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.937628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.937883 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.938574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.941115 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.951213 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:55.951894 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:55.952168 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:55.952433 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] PATH_INFO: `/v3/projects/b524896d4ac1427c90c2cf4f20721b9c/users/8059aa72009e437c987bb7460f504f20/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:55.966660 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1250/2522] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:07:55 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:07:55.971059 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:55.973039 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b524896d4ac1427c90c2cf4f20721b9c, user_id=8059aa72009e437c987bb7460f504f20, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:55.976310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:55.987873 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e22cd-ab07-4cbb-b270-7231927585b6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:55.993057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1273/2523] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:55 2022] PUT /identity/v3/projects/b524896d4ac1427c90c2cf4f20721b9c/users/8059aa72009e437c987bb7460f504f20/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:55.997257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:56.015988 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:56.058278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.058934 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.059207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.059770 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.060118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.061943 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.075690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1251/2524] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:56.079675 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:56.081822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00dbc0f-7f84-4806-a9c6-08881f87e415 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:56.087691 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.088610 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.088944 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.089591 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.090068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.091644 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931ea91-eba8-48a0-b411-71a5978c97a7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:56.092140 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.097079 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.098180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.098180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.098389 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.099184 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.100833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.105280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1274/2525] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:56.109570 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:56.113367 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1252/2526] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:07:56.117579 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:56.129182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc0129-a970-405c-8152-2616e748b6fa admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:56.129182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85634d03-a877-44c8-86fd-7fd19267ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.129182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634d03-a877-44c8-86fd-7fd19267ba2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.129182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634d03-a877-44c8-86fd-7fd19267ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.130029 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85634d03-a877-44c8-86fd-7fd19267ba2e admin admin] PATH_INFO: `/v3/projects/b524896d4ac1427c90c2cf4f20721b9c/users/8059aa72009e437c987bb7460f504f20/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.131844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85634d03-a877-44c8-86fd-7fd19267ba2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b524896d4ac1427c90c2cf4f20721b9c, user_id=8059aa72009e437c987bb7460f504f20, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.134995 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85634d03-a877-44c8-86fd-7fd19267ba2e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.145887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4581ee8-a4b3-4660-9558-f9584022704b admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:56.147136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1275/2527] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:56 2022] PUT /identity/v3/projects/b524896d4ac1427c90c2cf4f20721b9c/users/8059aa72009e437c987bb7460f504f20/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:56.160092 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.160369 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.160742 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.214376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] MFA Rules not processed for user `8059aa72009e437c987bb7460f504f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:56.215682 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:56.224434 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a896-6e3e-4d0e-94e1-ce092b0ffa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.225142 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a896-6e3e-4d0e-94e1-ce092b0ffa0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.225422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a896-6e3e-4d0e-94e1-ce092b0ffa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.225735 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a896-6e3e-4d0e-94e1-ce092b0ffa0d admin admin] PATH_INFO: `/v3/projects/bb93fa0a9efb4a24a65a02afcf830141/users/ec3447da06304c2d82692cab1ab543ed/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.250697 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208a896-6e3e-4d0e-94e1-ce092b0ffa0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb93fa0a9efb4a24a65a02afcf830141, user_id=ec3447da06304c2d82692cab1ab543ed, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.253313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208a896-6e3e-4d0e-94e1-ce092b0ffa0d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.272171 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1253/2528] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:07:56 2022] PUT /identity/v3/projects/bb93fa0a9efb4a24a65a02afcf830141/users/ec3447da06304c2d82692cab1ab543ed/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:07:56.283278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.283561 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.283828 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.305103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1276/2529] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:07:56.313744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] MFA Rules not processed for user `ec3447da06304c2d82692cab1ab543ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:07:56.314991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:56.317052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:56.318994 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:56.367960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:56.392371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1254/2530] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:07:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:07:56.405784 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b41dc5-a01d-4350-83ff-758c57a372c0 None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:56.407078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:56.408007 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:56.447621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:56.464078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.464681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.464984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.465249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.467133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:56.476415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc54f5-edab-4b6e-b3b7-56116e7de3cf None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:56.480273 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.480917 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.481187 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.481455 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.491046 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.492515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.503877 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1255/2531] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:56.504911 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:56.506283 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:56.541897 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.543370 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.556590 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1277/2532] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:07:56.575620 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579220f-ac09-4d71-a4eb-14c0c3aea4c6 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:56.579777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:56.580465 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:56.580816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:56.581160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:56.583189 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:07:56.653858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:56.655382 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:56.670158 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1256/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:58.227575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:58.237622 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f736b10-1391-473b-a99b-b3c07a37b8f5 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:58.242292 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:58.243715 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:58.244008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:58.244300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:58.319826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:58.321743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:58.332379 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1278/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:07:59.212205 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:07:59.231216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c9dc-df0c-41ab-8401-6da8daba5549 service neutron] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:07:59.240690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121f0e5-8321-4a78-bc63-db375553ca20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:07:59.242044 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121f0e5-8321-4a78-bc63-db375553ca20 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:07:59.242739 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121f0e5-8321-4a78-bc63-db375553ca20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:07:59.243461 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121f0e5-8321-4a78-bc63-db375553ca20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:07:59.389605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121f0e5-8321-4a78-bc63-db375553ca20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:07:59.392744 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121f0e5-8321-4a78-bc63-db375553ca20 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:07:59.408202 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1257/2535] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:07:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:03.714249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:03.750329 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:03.788458 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8622aa0-82e3-4e8b-8736-0def4361cf61 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:03.793368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:03.794020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:03.794285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:03.794574 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] PATH_INFO: `/v3/users/9d354d9f209a4fdca511b4d41ac09774` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:03.795733 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d354d9f209a4fdca511b4d41ac09774)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:03.797681 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:03.852676 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d354d9f209a4fdca511b4d41ac09774'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:03.853350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d354d9f209a4fdca511b4d41ac09774'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:03.861182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d354d9f209a4fdca511b4d41ac09774'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:03.871316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d354d9f209a4fdca511b4d41ac09774'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:03.886883 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d354d9f209a4fdca511b4d41ac09774'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:03.899893 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1279/2536] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:03 2022] DELETE /identity/v3/users/9d354d9f209a4fdca511b4d41ac09774 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:03.905300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:03.906008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:03.906008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:03.928403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:03.929615 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:03.938656 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=100 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:03.995845 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1258/2537] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:08:04.006141 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:04.007812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:04.070541 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3e138-2722-4f78-9a80-726f571b9f10 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:04.074352 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:04.074984 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:04.075259 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:04.075537 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:04.084896 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:04.086321 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:04.096008 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1280/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:04.380693 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:04.382745 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:04.395622 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5d4c-d913-4593-9910-c6e31676179a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:04.401227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:04.401892 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:04.402169 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:04.402394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] PATH_INFO: `/v3/projects/52848c5ff79a4fd88ecd62635f245a7c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:04.403685 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] RBAC: Authorizing `identity:delete_project(project_id=52848c5ff79a4fd88ecd62635f245a7c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:04.405609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:04.458068 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52848c5ff79a4fd88ecd62635f245a7c', 'request_id': 'req-0de6a4fd-d28a-4167-8e4d-f694784a17be'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.464097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52848c5ff79a4fd88ecd62635f245a7c', 'request_id': 'req-0de6a4fd-d28a-4167-8e4d-f694784a17be'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.472350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52848c5ff79a4fd88ecd62635f245a7c', 'request_id': 'req-0de6a4fd-d28a-4167-8e4d-f694784a17be'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.484423 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] The token cache is being invalidate because project 52848c5ff79a4fd88ecd62635f245a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:04.484689 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.485658 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.487433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1259/2539] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:04 2022] DELETE /identity/v3/projects/52848c5ff79a4fd88ecd62635f245a7c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:04.491766 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:04.501838 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4179249-ada5-45f3-a7f7-594396b0d674 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:04.550007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:04.561277 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:04.562094 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:04.562621 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:04.562921 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] PATH_INFO: `/v3/users/a10a0514bd484eb9b2f885b273ef8689` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:04.564314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10a0514bd484eb9b2f885b273ef8689)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:04.566308 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:04.624721 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10a0514bd484eb9b2f885b273ef8689'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.625709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10a0514bd484eb9b2f885b273ef8689'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.635785 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10a0514bd484eb9b2f885b273ef8689'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.646143 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10a0514bd484eb9b2f885b273ef8689'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.659877 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10a0514bd484eb9b2f885b273ef8689'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:04.667459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1281/2540] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:04 2022] DELETE /identity/v3/users/a10a0514bd484eb9b2f885b273ef8689 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:04.968358 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:04.970430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:04.985227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6a4fd-d28a-4167-8e4d-f694784a17be admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:05.047163 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:05.047920 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:05.048267 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:05.048596 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] PATH_INFO: `/v3/projects/24a2f31de7c342238f18a8ec83ebe64b` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:05.049778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a2f31de7c342238f18a8ec83ebe64b)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:05.052245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:05.100807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:05.110094 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a2f31de7c342238f18a8ec83ebe64b', 'request_id': 'req-1359c553-960d-495a-b669-52603dbad1e8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.118701 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a2f31de7c342238f18a8ec83ebe64b', 'request_id': 'req-1359c553-960d-495a-b669-52603dbad1e8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.151585 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a2f31de7c342238f18a8ec83ebe64b', 'request_id': 'req-1359c553-960d-495a-b669-52603dbad1e8'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.164611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] The token cache is being invalidate because project 24a2f31de7c342238f18a8ec83ebe64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:05.165008 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.165521 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.167078 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1260/2541] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:04 2022] DELETE /identity/v3/projects/24a2f31de7c342238f18a8ec83ebe64b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:05.171374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:05.173164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:05.186494 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768646e-0929-4cec-a1fb-1f9f03a6fb1d admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:05.258126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:05.258731 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:05.259007 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:05.259276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] PATH_INFO: `/v3/users/8059aa72009e437c987bb7460f504f20` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:05.260879 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8059aa72009e437c987bb7460f504f20)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:05.262844 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:05.311043 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8059aa72009e437c987bb7460f504f20'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.311755 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8059aa72009e437c987bb7460f504f20'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.319710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8059aa72009e437c987bb7460f504f20'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.328672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8059aa72009e437c987bb7460f504f20'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.336300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:05.342882 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8059aa72009e437c987bb7460f504f20'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.349913 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1282/2542] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:05 2022] DELETE /identity/v3/users/8059aa72009e437c987bb7460f504f20 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:05.653836 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:05.655987 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:05.671882 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359c553-960d-495a-b669-52603dbad1e8 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:05.732668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:05.733313 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:05.733589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:05.733858 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] PATH_INFO: `/v3/projects/b524896d4ac1427c90c2cf4f20721b9c` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:05.735045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b524896d4ac1427c90c2cf4f20721b9c)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:05.737001 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:05.789684 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b524896d4ac1427c90c2cf4f20721b9c', 'request_id': 'req-8ad604d0-4782-44ca-8403-22074c6e2799'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.795081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b524896d4ac1427c90c2cf4f20721b9c', 'request_id': 'req-8ad604d0-4782-44ca-8403-22074c6e2799'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.804061 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b524896d4ac1427c90c2cf4f20721b9c', 'request_id': 'req-8ad604d0-4782-44ca-8403-22074c6e2799'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.816153 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] The token cache is being invalidate because project b524896d4ac1427c90c2cf4f20721b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:05.816437 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.817180 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:05.818730 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1261/2543] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:05 2022] DELETE /identity/v3/projects/b524896d4ac1427c90c2cf4f20721b9c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:06.183790 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:06.185657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:06.282812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e39b-c8ea-49be-a935-3e769c0413e4 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:06.351656 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ed380-3334-4d93-bf66-6bcf726569bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:06.353128 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ed380-3334-4d93-bf66-6bcf726569bc service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:06.353405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ed380-3334-4d93-bf66-6bcf726569bc service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:06.353672 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ed380-3334-4d93-bf66-6bcf726569bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:06.355983 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-056ed380-3334-4d93-bf66-6bcf726569bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:06.369569 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ed380-3334-4d93-bf66-6bcf726569bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:06.371280 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ed380-3334-4d93-bf66-6bcf726569bc service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:06.383217 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1283/2544] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:08.803526 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:08.805037 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:08.871315 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:08.875637 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad604d0-4782-44ca-8403-22074c6e2799 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:08.881742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:08.882573 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:08.882866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:08.883136 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] PATH_INFO: `/v3/users/ec3447da06304c2d82692cab1ab543ed` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:08.884289 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3447da06304c2d82692cab1ab543ed)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:08.886449 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:08.937034 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3447da06304c2d82692cab1ab543ed'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:08.937605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3447da06304c2d82692cab1ab543ed'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:08.951429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3447da06304c2d82692cab1ab543ed'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:08.958515 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3447da06304c2d82692cab1ab543ed'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:08.959491 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3447da06304c2d82692cab1ab543ed'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:08.976975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1262/2545] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:08 2022] DELETE /identity/v3/users/ec3447da06304c2d82692cab1ab543ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:08.981899 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:08.982368 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:08.982470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.003317 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:09.004545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:09.071538 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1284/2546] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:09.082897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:09.084589 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:09.146041 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7452-ea88-4d29-822f-4176ac2a8fef admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:09.149889 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e3ebd-ee0d-446d-b61e-6fa6ceaf4acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:09.150509 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e3ebd-ee0d-446d-b61e-6fa6ceaf4acd service neutron] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.150822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e3ebd-ee0d-446d-b61e-6fa6ceaf4acd service neutron] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.151092 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e3ebd-ee0d-446d-b61e-6fa6ceaf4acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.162300 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e3ebd-ee0d-446d-b61e-6fa6ceaf4acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:09.163890 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e3ebd-ee0d-446d-b61e-6fa6ceaf4acd service neutron] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:09.174483 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1263/2547] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:09.472885 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:09.474470 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:09.482202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:09.488727 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734174eb-d7e0-4a65-b87e-e5a9bdde2d2b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:09.495902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:09.496780 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.497264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.497600 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] PATH_INFO: `/v3/projects/bb93fa0a9efb4a24a65a02afcf830141` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.499047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb93fa0a9efb4a24a65a02afcf830141)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:09.501320 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:09.550765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb93fa0a9efb4a24a65a02afcf830141', 'request_id': 'req-0b382c4c-e80b-472e-9de6-c55efb7d4012'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:09.557182 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb93fa0a9efb4a24a65a02afcf830141', 'request_id': 'req-0b382c4c-e80b-472e-9de6-c55efb7d4012'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:09.564842 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb93fa0a9efb4a24a65a02afcf830141', 'request_id': 'req-0b382c4c-e80b-472e-9de6-c55efb7d4012'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:09.575683 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] The token cache is being invalidate because project bb93fa0a9efb4a24a65a02afcf830141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:09.575985 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:09.576598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-0b382c4c-e80b-472e-9de6-c55efb7d4012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:09.578136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1285/2548] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:09 2022] DELETE /identity/v3/projects/bb93fa0a9efb4a24a65a02afcf830141 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:09.583111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9b7c-f45e-4227-a53f-9e853306a037 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.583395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9b7c-f45e-4227-a53f-9e853306a037 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.583666 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd9b7c-f45e-4227-a53f-9e853306a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.605260 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-13cd9b7c-f45e-4227-a53f-9e853306a037 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:09.606493 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-13cd9b7c-f45e-4227-a53f-9e853306a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:09.672551 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1264/2549] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:09.681057 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4b20-cd94-41e0-b8df-aa9816f7b31a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.681337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4b20-cd94-41e0-b8df-aa9816f7b31a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.681608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4b20-cd94-41e0-b8df-aa9816f7b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.703448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-c45d4b20-cd94-41e0-b8df-aa9816f7b31a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:09.704663 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c45d4b20-cd94-41e0-b8df-aa9816f7b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:09.712880 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1286/2550] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:09.717411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9b7c-f45e-4227-a53f-9e853306a037 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:09.727345 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd9b7c-f45e-4227-a53f-9e853306a037 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:09.732314 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:09.732912 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.733183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.733447 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.734098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:08:09.734488 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:09.736032 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:09.748081 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1265/2551] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:08:09.752593 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d4b20-cd94-41e0-b8df-aa9816f7b31a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:09.762646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d4b20-cd94-41e0-b8df-aa9816f7b31a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:09.770119 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:09.770941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.771273 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.771668 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.772358 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:09.774680 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:09.803635 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1287/2552] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:08:09 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:09.808206 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:09.818784 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c95792-1587-4de4-8f47-0112a3e106f3 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:09.822869 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:09.883803 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:09.884529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.884896 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.885167 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.885949 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:09.887976 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:09.911302 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1266/2553] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:08:09 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:09.915900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:09.927073 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023ae10-d2bd-4d44-9274-36779d4efcba admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:09.932653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:09.933256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.933529 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.933812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.934448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:09.936074 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:09.953066 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1288/2554] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:08:09.958951 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:09.970241 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5089dd9-aa0b-4dcf-a706-6175bbb6ae60 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:09.975769 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea636e70-038a-42fd-aaf7-328bf67329bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:09.976396 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea636e70-038a-42fd-aaf7-328bf67329bc admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:09.976779 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea636e70-038a-42fd-aaf7-328bf67329bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:09.977028 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea636e70-038a-42fd-aaf7-328bf67329bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:09.977737 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea636e70-038a-42fd-aaf7-328bf67329bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:09.981278 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea636e70-038a-42fd-aaf7-328bf67329bc admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:09.991207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1267/2555] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:08:09.995791 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.006049 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f40272-587b-40b6-9528-8cd1cbd5be11 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.011513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.012195 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.012581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.012854 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] PATH_INFO: `/v3/projects/d8653dc4121b4912978aca1b7fcc6aa0/users/5c10485c569943e1bfa6bbe2684e6df6/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.029155 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8653dc4121b4912978aca1b7fcc6aa0, user_id=5c10485c569943e1bfa6bbe2684e6df6, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.031850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.046480 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1289/2556] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:08:09 2022] PUT /identity/v3/projects/d8653dc4121b4912978aca1b7fcc6aa0/users/5c10485c569943e1bfa6bbe2684e6df6/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:10.057309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd64e7-4a5f-47c8-9bf7-63e0cb491ed6 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.057690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd64e7-4a5f-47c8-9bf7-63e0cb491ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.057968 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd64e7-4a5f-47c8-9bf7-63e0cb491ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.088431 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-66dd64e7-4a5f-47c8-9bf7-63e0cb491ed6 None None] MFA Rules not processed for user `5c10485c569943e1bfa6bbe2684e6df6`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:10.089721 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-66dd64e7-4a5f-47c8-9bf7-63e0cb491ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:10.167628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1268/2557] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:10.172148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.237559 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c3702-05b6-478f-b293-005a30cae4d2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.243314 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.243902 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.244178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.244444 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.245202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.247147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.278095 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1290/2558] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:08:10 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:10.283040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd64e7-4a5f-47c8-9bf7-63e0cb491ed6 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.294422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd64e7-4a5f-47c8-9bf7-63e0cb491ed6 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.367067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.367910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.368403 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.368893 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.370090 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.373855 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.400303 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1269/2559] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:08:10 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:10.404891 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.417191 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05de469-38f8-4e91-9429-e5cb24d99742 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.422240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.422908 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.423179 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.423428 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.424078 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.425666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.427154 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:10.439640 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1291/2560] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:08:10.444248 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.450933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:10.454868 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2e64-1237-44b7-9c30-4a586106de09 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.461395 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd4c9-7c36-4cf9-815b-98a04c6153e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.462030 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd4c9-7c36-4cf9-815b-98a04c6153e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.462304 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd4c9-7c36-4cf9-815b-98a04c6153e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.462595 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd4c9-7c36-4cf9-815b-98a04c6153e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.463257 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd4c9-7c36-4cf9-815b-98a04c6153e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.464915 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd4c9-7c36-4cf9-815b-98a04c6153e0 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.476826 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1270/2561] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:08:10.481696 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.492377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2424d0-574e-45af-bd35-f7c4e5a3eaa0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.497171 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.497848 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.498113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.498386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] PATH_INFO: `/v3/projects/cdf7c67168244fa38476c235f91b024e/users/c011634769834467abca8e00c104d7d3/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.514765 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf7c67168244fa38476c235f91b024e, user_id=c011634769834467abca8e00c104d7d3, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.517709 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.534679 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1292/2562] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:08:10 2022] PUT /identity/v3/projects/cdf7c67168244fa38476c235f91b024e/users/c011634769834467abca8e00c104d7d3/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 11 12:08:10.547433 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d981-3b88-499e-bc35-0d927f71ebff None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.547710 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d981-3b88-499e-bc35-0d927f71ebff None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.547974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d981-3b88-499e-bc35-0d927f71ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.583097 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-af88d981-3b88-499e-bc35-0d927f71ebff None None] MFA Rules not processed for user `c011634769834467abca8e00c104d7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:10.584957 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-af88d981-3b88-499e-bc35-0d927f71ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:10.672578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1271/2563] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:10.677385 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.746814 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff6ad-a813-464b-b66e-40cac7df62a8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.755846 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.756664 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.757015 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.757334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.758014 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.761148 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.794647 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1293/2564] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:08:10 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:10.799498 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d981-3b88-499e-bc35-0d927f71ebff None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.812619 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d981-3b88-499e-bc35-0d927f71ebff None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.883829 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.884466 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.884742 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.885005 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] PATH_INFO: `/v3/users` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.886213 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.888654 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.912774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1272/2565] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:08:10 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 11 12:08:10.917523 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.932448 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba7e0-edbe-4e1a-a55d-d59ab3f337bb admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.938223 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.938890 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.939170 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.939441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.940091 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.941743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:10.953268 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1294/2566] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:08:10.957570 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:10.969070 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857cbd-ab85-47a6-ac1e-32967795c759 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:10.974346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:10.975045 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:10.975319 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:10.975583 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] PATH_INFO: `/v3/projects/62e69315faec4ed4975fe4b92e32b322/users/113e6defa7464e4bac67b87f50bb5274/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:10.991621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e69315faec4ed4975fe4b92e32b322, user_id=113e6defa7464e4bac67b87f50bb5274, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:10.994337 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:11.009537 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1273/2567] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:08:10 2022] PUT /identity/v3/projects/62e69315faec4ed4975fe4b92e32b322/users/113e6defa7464e4bac67b87f50bb5274/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:11.013609 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:11.024001 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1dcf3-c774-4f19-971e-ebd12d9f97e8 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:11.083605 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b36dd-2c6c-4519-ac7c-21707f503fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:11.084221 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b36dd-2c6c-4519-ac7c-21707f503fba admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:11.084497 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b36dd-2c6c-4519-ac7c-21707f503fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:11.084763 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b36dd-2c6c-4519-ac7c-21707f503fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:11.085410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b36dd-2c6c-4519-ac7c-21707f503fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:11.087079 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b36dd-2c6c-4519-ac7c-21707f503fba admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:11.097261 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1295/2568] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:08:11.101590 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:11.112448 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9eef2-9995-4438-90fb-63c0b6bcc86f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:11.117673 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:11.118355 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:11.118661 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:11.118924 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] PATH_INFO: `/v3/projects/62e69315faec4ed4975fe4b92e32b322/users/113e6defa7464e4bac67b87f50bb5274/roles/d32b6669146241ab9d1fda575c016787` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:11.121066 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e69315faec4ed4975fe4b92e32b322, user_id=113e6defa7464e4bac67b87f50bb5274, role_id=d32b6669146241ab9d1fda575c016787)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:11.123835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:11.134956 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1274/2569] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:08:11 2022] PUT /identity/v3/projects/62e69315faec4ed4975fe4b92e32b322/users/113e6defa7464e4bac67b87f50bb5274/roles/d32b6669146241ab9d1fda575c016787 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:11.145487 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:11.145786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:11.146053 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:11.176237 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] MFA Rules not processed for user `113e6defa7464e4bac67b87f50bb5274`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:11.177478 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:11.209263 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:11.251796 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1296/2570] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:11.263533 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:11.265346 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:11.310043 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:11.330846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de79ef-e7b4-48c7-9367-d4263cc8091f admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:11.335014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:11.335640 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:11.335898 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:11.336164 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:11.395529 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:11.397010 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:11.406058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1275/2571] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 11 12:08:12.952718 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:12.954270 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:12.967164 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e619e5-67be-4a61-9b34-45509bcec65f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:12.971105 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:12.971646 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:12.971919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:12.972176 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:13.032688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:13.034133 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:13.044169 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1297/2572] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:13.639332 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:13.649923 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43887b2f-174b-42db-883b-d4698f8651c2 service cinder] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:13.654926 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb6f54-ba79-4042-95b8-751d1f5228f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:13.655574 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb6f54-ba79-4042-95b8-751d1f5228f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:13.655847 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb6f54-ba79-4042-95b8-751d1f5228f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:13.656110 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb6f54-ba79-4042-95b8-751d1f5228f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:13.667411 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb6f54-ba79-4042-95b8-751d1f5228f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:13.669067 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb6f54-ba79-4042-95b8-751d1f5228f7 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:13.680093 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1276/2573] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:17.699698 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:17.773249 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6e210-b9b2-45b4-a4d0-152584dcbb34 service cinder] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:17.778178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:17.779048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:17.779258 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:17.779533 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] PATH_INFO: `/v3/users/5c10485c569943e1bfa6bbe2684e6df6` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:17.780670 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c10485c569943e1bfa6bbe2684e6df6)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:17.782688 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:17.835596 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c10485c569943e1bfa6bbe2684e6df6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:17.836276 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c10485c569943e1bfa6bbe2684e6df6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:17.844055 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c10485c569943e1bfa6bbe2684e6df6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:17.854086 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c10485c569943e1bfa6bbe2684e6df6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:17.859024 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:17.868743 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c10485c569943e1bfa6bbe2684e6df6'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:17.876552 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1298/2574] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:17 2022] DELETE /identity/v3/users/5c10485c569943e1bfa6bbe2684e6df6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:17.881625 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:17.882149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:17.882149 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:17.903285 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:17.904524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:17.970794 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1277/2575] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:08:17.981104 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:17.983550 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:18.067246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8d68-911e-47ab-8057-857df89d8842 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:18.071469 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:18.072090 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:18.072366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:18.072633 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:18.082900 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:18.084334 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:18.094347 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1299/2576] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:18.437422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:18.439155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:18.452252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ff7c3-7fb1-4702-bb18-6b29b8f8871e None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:18.458082 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:18.459295 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:18.459556 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:18.461051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] PATH_INFO: `/v3/projects/d8653dc4121b4912978aca1b7fcc6aa0` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:18.463587 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8653dc4121b4912978aca1b7fcc6aa0)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:18.465373 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:18.521712 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8653dc4121b4912978aca1b7fcc6aa0', 'request_id': 'req-7b541874-4765-4caa-aead-10fbc14037b6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.529826 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8653dc4121b4912978aca1b7fcc6aa0', 'request_id': 'req-7b541874-4765-4caa-aead-10fbc14037b6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.541306 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8653dc4121b4912978aca1b7fcc6aa0', 'request_id': 'req-7b541874-4765-4caa-aead-10fbc14037b6'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.550096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:18.554392 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] The token cache is being invalidate because project d8653dc4121b4912978aca1b7fcc6aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:18.554716 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.555470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.557309 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1278/2577] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:18 2022] DELETE /identity/v3/projects/d8653dc4121b4912978aca1b7fcc6aa0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:18.562076 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:18.572045 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c60459-0caf-4bf2-9feb-3cd7f34b2af8 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:18.634161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:18.634826 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:18.635100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:18.635367 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] PATH_INFO: `/v3/users/c011634769834467abca8e00c104d7d3` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:18.636608 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c011634769834467abca8e00c104d7d3)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:18.638686 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:18.695614 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c011634769834467abca8e00c104d7d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.696390 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c011634769834467abca8e00c104d7d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.704017 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c011634769834467abca8e00c104d7d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.713126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c011634769834467abca8e00c104d7d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.719802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:18.731781 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c011634769834467abca8e00c104d7d3'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:18.740376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1300/2578] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:18 2022] DELETE /identity/v3/users/c011634769834467abca8e00c104d7d3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:19.037102 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:19.038652 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:19.055430 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b541874-4765-4caa-aead-10fbc14037b6 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:19.122151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:19.122846 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:19.123160 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:19.123456 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] PATH_INFO: `/v3/projects/cdf7c67168244fa38476c235f91b024e` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:19.124651 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf7c67168244fa38476c235f91b024e)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:19.126990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:19.176800 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf7c67168244fa38476c235f91b024e', 'request_id': 'req-cafcd29e-5a81-41e0-b1a4-0770136ae427'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.185979 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf7c67168244fa38476c235f91b024e', 'request_id': 'req-cafcd29e-5a81-41e0-b1a4-0770136ae427'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.195935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf7c67168244fa38476c235f91b024e', 'request_id': 'req-cafcd29e-5a81-41e0-b1a4-0770136ae427'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.208925 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] The token cache is being invalidate because project cdf7c67168244fa38476c235f91b024e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:19.209155 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.209854 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.211480 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1279/2579] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:19 2022] DELETE /identity/v3/projects/cdf7c67168244fa38476c235f91b024e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:19.216581 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:19.218479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:19.236629 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea101-8f63-4d02-9ee7-d364f3e3cdbe admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:19.300403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:19.301047 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:19.301324 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:19.301598 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] PATH_INFO: `/v3/users/113e6defa7464e4bac67b87f50bb5274` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:19.302771 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=113e6defa7464e4bac67b87f50bb5274)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:19.304710 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:19.355822 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113e6defa7464e4bac67b87f50bb5274'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.356502 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113e6defa7464e4bac67b87f50bb5274'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.363759 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113e6defa7464e4bac67b87f50bb5274'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.372100 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113e6defa7464e4bac67b87f50bb5274'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.385466 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-56244a2c-4c2a-4eb7-b590-7b4d48c9e93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113e6defa7464e4bac67b87f50bb5274'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.391786 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1301/2580] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:19 2022] DELETE /identity/v3/users/113e6defa7464e4bac67b87f50bb5274 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:19.690774 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:19.693040 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:19.710322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcd29e-5a81-41e0-b1a4-0770136ae427 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:19.776053 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:19.776626 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:19.776903 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:19.777173 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] PATH_INFO: `/v3/projects/62e69315faec4ed4975fe4b92e32b322` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:19.778360 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e69315faec4ed4975fe4b92e32b322)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:19.780412 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:19.825628 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:19.840623 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e69315faec4ed4975fe4b92e32b322', 'request_id': 'req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.847440 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e69315faec4ed4975fe4b92e32b322', 'request_id': 'req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.856458 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e69315faec4ed4975fe4b92e32b322', 'request_id': 'req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.868422 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] The token cache is being invalidate because project 62e69315faec4ed4975fe4b92e32b322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:19.868700 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.869364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-7eef02fb-58d4-4b1c-9054-25ff0e4aed99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:19.870938 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1280/2581] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:19 2022] DELETE /identity/v3/projects/62e69315faec4ed4975fe4b92e32b322 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:19.876220 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f541-1873-4ea5-a5bf-7eb24cf2aace None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:19.876925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f541-1873-4ea5-a5bf-7eb24cf2aace None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:19.876925 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606f541-1873-4ea5-a5bf-7eb24cf2aace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:19.898238 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-5606f541-1873-4ea5-a5bf-7eb24cf2aace None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:19.899521 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-5606f541-1873-4ea5-a5bf-7eb24cf2aace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:19.966381 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1302/2582] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:08:19.974476 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df27c5-9981-495e-afda-0381de53eb00 None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:19.974797 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df27c5-9981-495e-afda-0381de53eb00 None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:19.975056 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df27c5-9981-495e-afda-0381de53eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:19.996947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-75df27c5-9981-495e-afda-0381de53eb00 None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:19.998240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-75df27c5-9981-495e-afda-0381de53eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:20.007490 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1281/2583] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:08:20.013895 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606f541-1873-4ea5-a5bf-7eb24cf2aace None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.024405 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606f541-1873-4ea5-a5bf-7eb24cf2aace None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.030286 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.030857 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.031129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.031393 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.032042 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:08:20.032337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.033947 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.035491 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:20.048792 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1303/2584] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 11 12:08:20.053381 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df27c5-9981-495e-afda-0381de53eb00 None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.063339 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df27c5-9981-495e-afda-0381de53eb00 None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.069298 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.069919 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.070185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.070450 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.071129 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.073051 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.103910 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1282/2585] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:08:20 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:20.108745 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.119479 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bc717-7011-4d3c-89be-14daddc6a4f2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.184212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.184850 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.185107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.185399 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.186048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.188012 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.210230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1304/2586] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:08:20 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:20.214990 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.227767 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5508e-7468-428c-8357-fb94c7175c5a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.233191 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.233810 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.234107 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.234371 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.235039 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.236672 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.249338 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1283/2587] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:08:20.253912 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.265202 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ca84-26e9-4212-94e1-d1f0cff3bb99 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.270746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7c4af-0f2f-4695-a8d3-86c8175b2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.271365 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7c4af-0f2f-4695-a8d3-86c8175b2e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.271642 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7c4af-0f2f-4695-a8d3-86c8175b2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.271901 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7c4af-0f2f-4695-a8d3-86c8175b2e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.272566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7c4af-0f2f-4695-a8d3-86c8175b2e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.274161 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc7c4af-0f2f-4695-a8d3-86c8175b2e79 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.286968 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1305/2588] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:08:20.291429 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.302482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4f48e-e9db-40b3-aa4e-cb687405c21d admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.307804 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.308464 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.308725 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.309025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] PATH_INFO: `/v3/projects/d27210c470764e3393774ca692ff0810/users/358f8751a7594903ba525453cea7e3ec/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.327014 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27210c470764e3393774ca692ff0810, user_id=358f8751a7594903ba525453cea7e3ec, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.330350 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.346862 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1284/2589] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:08:20 2022] PUT /identity/v3/projects/d27210c470764e3393774ca692ff0810/users/358f8751a7594903ba525453cea7e3ec/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:20.419097 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab78f9-aaab-44a1-8c3b-9934bef7911a None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.419387 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab78f9-aaab-44a1-8c3b-9934bef7911a None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.419634 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab78f9-aaab-44a1-8c3b-9934bef7911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.449205 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-3cab78f9-aaab-44a1-8c3b-9934bef7911a None None] MFA Rules not processed for user `358f8751a7594903ba525453cea7e3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:20.450426 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-3cab78f9-aaab-44a1-8c3b-9934bef7911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:20.521872 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1306/2590] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:20.534986 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.537487 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:20.603931 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd61856-9efb-4af9-94e3-d760d5a8d4fa admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.607906 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77f05b-02ee-4144-a9a5-ea4e7cdd8034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.608544 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f05b-02ee-4144-a9a5-ea4e7cdd8034 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.608822 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f05b-02ee-4144-a9a5-ea4e7cdd8034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.609091 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f05b-02ee-4144-a9a5-ea4e7cdd8034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.619292 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77f05b-02ee-4144-a9a5-ea4e7cdd8034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.620835 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77f05b-02ee-4144-a9a5-ea4e7cdd8034 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.634757 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1285/2591] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:20.675452 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab78f9-aaab-44a1-8c3b-9934bef7911a None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.751300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab78f9-aaab-44a1-8c3b-9934bef7911a None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:20.756624 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:20.757310 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.757555 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.757819 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] PATH_INFO: `/v3/users/358f8751a7594903ba525453cea7e3ec` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.759136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358f8751a7594903ba525453cea7e3ec)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:20.761108 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:20.764542 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:20.820115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358f8751a7594903ba525453cea7e3ec'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:20.820754 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358f8751a7594903ba525453cea7e3ec'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:20.828566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358f8751a7594903ba525453cea7e3ec'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:20.836757 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358f8751a7594903ba525453cea7e3ec'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:20.850065 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358f8751a7594903ba525453cea7e3ec'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:20.856566 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1307/2592] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:20 2022] DELETE /identity/v3/users/358f8751a7594903ba525453cea7e3ec => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:20.861342 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:20.861621 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:20.861891 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:20.883743 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:20.884980 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:20.947281 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:20.965692 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1286/2593] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:20.976619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:20.978514 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:21.041115 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a67010-47bb-4d9a-93b3-a1a4e8dba7f2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.045264 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a65047-fffa-4a1c-8058-429ea87c5899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.045898 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65047-fffa-4a1c-8058-429ea87c5899 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.046103 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65047-fffa-4a1c-8058-429ea87c5899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.046403 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65047-fffa-4a1c-8058-429ea87c5899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.061330 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a65047-fffa-4a1c-8058-429ea87c5899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.064229 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a65047-fffa-4a1c-8058-429ea87c5899 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.081528 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1308/2594] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:21.373978 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:21.375708 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:21.389322 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab6431-48f8-4882-939f-898dc2551f1a None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.397997 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.398932 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.399266 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.399634 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] PATH_INFO: `/v3/projects/d27210c470764e3393774ca692ff0810` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.401156 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27210c470764e3393774ca692ff0810)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.403502 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.458524 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27210c470764e3393774ca692ff0810', 'request_id': 'req-42899c86-4a56-48df-acde-ecdf92c62b82'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:21.465058 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27210c470764e3393774ca692ff0810', 'request_id': 'req-42899c86-4a56-48df-acde-ecdf92c62b82'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:21.477470 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27210c470764e3393774ca692ff0810', 'request_id': 'req-42899c86-4a56-48df-acde-ecdf92c62b82'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:21.490096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] The token cache is being invalidate because project d27210c470764e3393774ca692ff0810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:21.490385 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:21.491183 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-42899c86-4a56-48df-acde-ecdf92c62b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:21.492816 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1287/2595] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:21 2022] DELETE /identity/v3/projects/d27210c470764e3393774ca692ff0810 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:21.498671 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2625-c228-4cfe-b950-8a993faecc0f None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.498960 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2625-c228-4cfe-b950-8a993faecc0f None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.499246 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef2625-c228-4cfe-b950-8a993faecc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.527945 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-75ef2625-c228-4cfe-b950-8a993faecc0f None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:21.529391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-75ef2625-c228-4cfe-b950-8a993faecc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:21.593114 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1309/2596] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 11 12:08:21.601246 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6d243-995b-4c54-a3a6-676d313d3ddf None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.601575 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6d243-995b-4c54-a3a6-676d313d3ddf None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.601902 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6d243-995b-4c54-a3a6-676d313d3ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.623610 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-d4e6d243-995b-4c54-a3a6-676d313d3ddf None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:21.624787 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-d4e6d243-995b-4c54-a3a6-676d313d3ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:21.634122 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1288/2597] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:21.638758 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2625-c228-4cfe-b950-8a993faecc0f None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:21.649333 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef2625-c228-4cfe-b950-8a993faecc0f None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.654867 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.655493 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.655772 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.656041 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.656859 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 11 12:08:21.657068 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.658613 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.673870 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1310/2598] 10.222.0.48 () {58 vars in 1153 bytes} [Tue Oct 11 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 11 12:08:21.678578 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6d243-995b-4c54-a3a6-676d313d3ddf None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:21.688404 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6d243-995b-4c54-a3a6-676d313d3ddf None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.694135 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.694825 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.695098 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.695357 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.696018 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.697937 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.730060 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1289/2599] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 11 12:08:21 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:21.734545 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:21.745337 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c47b1-36b5-4718-96f6-833bc36498b5 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.756419 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:21.819350 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.819974 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.820243 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.820501 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] PATH_INFO: `/v3/users` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.821468 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.823113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.846812 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1311/2600] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Oct 11 12:08:21 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 11 12:08:21.851207 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:21.862609 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04a1d1-7a44-49cb-9b8d-dcd6749d1f99 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.867992 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.868611 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.868881 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.869143 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.869791 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.871432 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.882605 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1290/2601] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 11 12:08:21.887376 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:21.901125 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed42e5b-711f-4fef-9823-0b110183ce05 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.908244 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c75e5d-1ff1-48ce-a534-810911ddf919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.909230 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c75e5d-1ff1-48ce-a534-810911ddf919 admin admin] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.909666 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c75e5d-1ff1-48ce-a534-810911ddf919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.910109 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c75e5d-1ff1-48ce-a534-810911ddf919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.911212 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c75e5d-1ff1-48ce-a534-810911ddf919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.913943 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c75e5d-1ff1-48ce-a534-810911ddf919 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.927934 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1312/2602] 10.222.0.48 () {58 vars in 1122 bytes} [Tue Oct 11 12:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 11 12:08:21.933204 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:21.944897 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67815a-28f6-4c8e-9cd9-3f4f84bf0e8a admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:21.951555 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:21.952239 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] REQUEST_METHOD: `PUT` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:21.952508 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:21.952768 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] PATH_INFO: `/v3/projects/1472bd5176cd4b5da070d80f2bdce543/users/d97cc1a7cf504095894f749d4743a99c/roles/4b08dbe46a7c4b618462666ee2e4b395` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:21.969971 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1472bd5176cd4b5da070d80f2bdce543, user_id=d97cc1a7cf504095894f749d4743a99c, role_id=4b08dbe46a7c4b618462666ee2e4b395)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:21.972668 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:21.990994 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1291/2603] 10.222.0.48 () {60 vars in 1483 bytes} [Tue Oct 11 12:08:21 2022] PUT /identity/v3/projects/1472bd5176cd4b5da070d80f2bdce543/users/d97cc1a7cf504095894f749d4743a99c/roles/4b08dbe46a7c4b618462666ee2e4b395 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:22.002707 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6bd29-1e37-49ea-bc96-a7ce613a7f5b None None] REQUEST_METHOD: `POST` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:22.003183 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6bd29-1e37-49ea-bc96-a7ce613a7f5b None None] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:22.003653 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6bd29-1e37-49ea-bc96-a7ce613a7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:22.032219 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.auth.core [None req-d4d6bd29-1e37-49ea-bc96-a7ce613a7f5b None None] MFA Rules not processed for user `d97cc1a7cf504095894f749d4743a99c`. Rule list: `[]` (Enabled: `True`). {{(pid=81390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:22.033435 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-d4d6bd29-1e37-49ea-bc96-a7ce613a7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:22.109441 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1313/2604] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:22.120618 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:22.122821 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:22.207118 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f9cf-dfb2-4ca4-94f3-1c9bee2e922c admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:22.211193 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51595871-10fc-428b-b53a-91067e6f92b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb63e30c48464c1ebe9305c620291c5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:22.211807 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51595871-10fc-428b-b53a-91067e6f92b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:22.212083 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51595871-10fc-428b-b53a-91067e6f92b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:22.212352 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51595871-10fc-428b-b53a-91067e6f92b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:22.221545 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51595871-10fc-428b-b53a-91067e6f92b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:22.223025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51595871-10fc-428b-b53a-91067e6f92b6 service cinder] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:22.232096 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1292/2605] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:32.106113 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:32.227947 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:32.497287 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6bd29-1e37-49ea-bc96-a7ce613a7f5b None None] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:32.565746 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6bd29-1e37-49ea-bc96-a7ce613a7f5b None None] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:32.571459 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:32.572110 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:32.572386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:32.572657 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] PATH_INFO: `/v3/users/d97cc1a7cf504095894f749d4743a99c` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:32.573841 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97cc1a7cf504095894f749d4743a99c)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:32.575820 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:32.630410 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97cc1a7cf504095894f749d4743a99c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:32.631126 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97cc1a7cf504095894f749d4743a99c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:32.638601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97cc1a7cf504095894f749d4743a99c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:32.647281 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97cc1a7cf504095894f749d4743a99c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:32.660136 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97cc1a7cf504095894f749d4743a99c'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:32.669240 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1314/2606] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:08:32 2022] DELETE /identity/v3/users/d97cc1a7cf504095894f749d4743a99c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:32.673974 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:32.674216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:32.674507 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:32.696486 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] MFA Rules not processed for user `0c6f9a858cab4edb80d37349ae653b91`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:08:32.697832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:32.770151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1293/2607] 10.222.0.48 () {58 vars in 958 bytes} [Tue Oct 11 12:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:08:32.781975 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:32.783787 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:32.852834 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32dd8c-9e45-4976-92f3-bedaf7dc91a0 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:32.857147 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '985db5d7ded74dbeaa8fae4515fea049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:32.857860 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:32.858134 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:32.858400 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:32.868831 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:32.870285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:32.881451 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1315/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:08:33.207778 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:08:33.209341 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:08:33.225426 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20455e3-3850-4b8c-a71a-3aa75ddf3e0c None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:08:33.230606 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:08:33.231519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:08:33.231519 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:08:33.232216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] PATH_INFO: `/v3/projects/1472bd5176cd4b5da070d80f2bdce543` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:08:33.233263 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1472bd5176cd4b5da070d80f2bdce543)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:08:33.235354 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:08:33.296147 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1472bd5176cd4b5da070d80f2bdce543', 'request_id': 'req-d582f880-4d0f-4647-8805-84dbaa9213f5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:33.303344 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1472bd5176cd4b5da070d80f2bdce543', 'request_id': 'req-d582f880-4d0f-4647-8805-84dbaa9213f5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:33.317884 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1472bd5176cd4b5da070d80f2bdce543', 'request_id': 'req-d582f880-4d0f-4647-8805-84dbaa9213f5'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:33.331272 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] The token cache is being invalidate because project 1472bd5176cd4b5da070d80f2bdce543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:08:33.331568 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:33.332227 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-d582f880-4d0f-4647-8805-84dbaa9213f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:08:33.333826 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1294/2609] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:08:33 2022] DELETE /identity/v3/projects/1472bd5176cd4b5da070d80f2bdce543 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:08:42.876302 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:43.327935 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:17.869331 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:09:17.870543 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:18.003513 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cd9ba-3a1d-4118-822d-7b4b64c41471 service neutron] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:09:18.087257 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fb3dc7226c48f1a33c6e73d3ff32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:09:18.087898 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:18.088353 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:18.088756 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:18.091386 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:18.112619 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:09:18.114157 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:09:18.126366 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1316/2610] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:09:24.157729 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] REQUEST_METHOD: `POST` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:24.158245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:24.158245 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:24.187991 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.auth.core [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] MFA Rules not processed for user `3acdcbc6be244b96a620a6e5ec894f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 11 12:09:24.189185 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:24.246117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1295/2611] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 11 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 11 12:09:24.289575 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:09:24.291052 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:24.352256 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=100 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:24.367048 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c54b7-c0e9-480b-82b2-563987777f07 service nova] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:09:24.372316 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f947cc3d958a49549b74d210453f2ced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:09:24.372931 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:24.373207 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:24.373474 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:24.382508 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:09:24.384124 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:09:24.392811 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1317/2612] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 11 12:09:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 11 12:09:27.959099 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:09:27.961151 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:28.074127 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721d1d3-c798-4cf2-b80d-b52ba3f83b7b None None] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:09:28.080271 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:09:28.080933 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] REQUEST_METHOD: `GET` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:28.081212 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:28.081546 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:28.083399 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:28.096592 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:09:28.098216 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:09:28.109240 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1296/2613] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:09:31.256081 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:09:31.257615 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:31.350339 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa49b32-9d3f-45b0-bc48-362e51981a05 service swift] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:09:31.355275 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:09:31.355993 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:31.356300 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:31.356572 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] PATH_INFO: `/v3/users/3953146fa9c04656b453fa8b5c953c85` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:31.357770 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3953146fa9c04656b453fa8b5c953c85)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:09:31.359862 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:09:31.416782 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3953146fa9c04656b453fa8b5c953c85'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.417439 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3953146fa9c04656b453fa8b5c953c85'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.425178 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3953146fa9c04656b453fa8b5c953c85'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.435080 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3953146fa9c04656b453fa8b5c953c85'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.449020 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3953146fa9c04656b453fa8b5c953c85'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.456193 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1318/2614] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:09:31 2022] DELETE /identity/v3/users/3953146fa9c04656b453fa8b5c953c85 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:09:31.656639 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:09:31.673747 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14110c-ad18-4ea9-b26a-291212654c25 service placement] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:09:31.740401 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:09:31.741025 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:31.741296 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:31.741566 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] PATH_INFO: `/v3/projects/18ca8cf88c9a4c4da79b740d45f9fdff` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:31.742832 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ca8cf88c9a4c4da79b740d45f9fdff)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:09:31.744777 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:09:31.782111 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:31.800510 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ca8cf88c9a4c4da79b740d45f9fdff', 'request_id': 'req-6e1cae07-30e2-481a-95cf-42070e072eb7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.805895 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ca8cf88c9a4c4da79b740d45f9fdff', 'request_id': 'req-6e1cae07-30e2-481a-95cf-42070e072eb7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.814364 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ca8cf88c9a4c4da79b740d45f9fdff', 'request_id': 'req-6e1cae07-30e2-481a-95cf-42070e072eb7'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.825541 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] The token cache is being invalidate because project 18ca8cf88c9a4c4da79b740d45f9fdff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:09:31.825833 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.826471 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.828103 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1297/2615] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:09:31 2022] DELETE /identity/v3/projects/18ca8cf88c9a4c4da79b740d45f9fdff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:09:31.832285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:09:31.833802 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:31.847153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c25d1-f980-48ad-afac-ed04e1f7ec3e admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:09:31.907951 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:09:31.908601 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:31.908853 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:31.909153 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] PATH_INFO: `/v3/users/fc17912276814124af2cc33cb13015cc` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:31.910374 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc17912276814124af2cc33cb13015cc)` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:09:31.912773 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:09:31.918825 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:31.967582 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc17912276814124af2cc33cb13015cc'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.968288 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc17912276814124af2cc33cb13015cc'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.976377 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc17912276814124af2cc33cb13015cc'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:31.986107 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc17912276814124af2cc33cb13015cc'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:32.001285 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.notifications [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc17912276814124af2cc33cb13015cc'} {{(pid=81390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:32.007499 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1319/2616] 10.222.0.48 () {58 vars in 1224 bytes} [Tue Oct 11 12:09:31 2022] DELETE /identity/v3/users/fc17912276814124af2cc33cb13015cc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:09:32.188188 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Authenticating user token {{(pid=81391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:09:32.189707 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.fernet_utils [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:09:32.205451 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cae07-30e2-481a-95cf-42070e072eb7 admin admin] Validating token access rules against request {{(pid=81391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:09:32.265482 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6f9a858cab4edb80d37349ae653b91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be0e0b74041048e6a742ee9441a4f3f2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:09:32.266122 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:09:32.266394 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:09:32.266690 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] PATH_INFO: `/v3/projects/004ee01fb90a4b82afe4d41f84cc8cb1` {{(pid=81391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:09:32.267866 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004ee01fb90a4b82afe4d41f84cc8cb1)` {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:09:32.269849 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] RBAC: Authorization granted {{(pid=81391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:09:32.318415 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004ee01fb90a4b82afe4d41f84cc8cb1', 'request_id': 'req-902978dd-caa8-4e76-a509-f7a3be15c573'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:32.323887 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004ee01fb90a4b82afe4d41f84cc8cb1', 'request_id': 'req-902978dd-caa8-4e76-a509-f7a3be15c573'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:32.332252 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004ee01fb90a4b82afe4d41f84cc8cb1', 'request_id': 'req-902978dd-caa8-4e76-a509-f7a3be15c573'} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:32.343691 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] The token cache is being invalidate because project 004ee01fb90a4b82afe4d41f84cc8cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 11 12:09:32.343975 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:32.344602 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG keystone.notifications [None req-902978dd-caa8-4e76-a509-f7a3be15c573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 11 12:09:32.346117 dv-cinder-820994-6-smb devstack@keystone.service[81391]: [pid: 81391|app: 0|req: 1298/2617] 10.222.0.48 () {58 vars in 1233 bytes} [Tue Oct 11 12:09:32 2022] DELETE /identity/v3/projects/004ee01fb90a4b82afe4d41f84cc8cb1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 11 12:09:42.003941 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:42.340954 dv-cinder-820994-6-smb devstack@keystone.service[81391]: DEBUG dbcounter [-] [81391] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:11.154129 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Authenticating user token {{(pid=81390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 11 12:13:11.155954 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:13:11.232654 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af6a82-e10b-4d2f-abbe-8bca722fbce2 admin admin] Validating token access rules against request {{(pid=81390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 11 12:13:11.300291 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad4f55-ad3c-414d-a5ff-f02c854e881b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba839bb4641430cb81a78a8d8242a11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdeb1af6f5774cc68dd64c5665c178f5', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 11 12:13:11.300917 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad4f55-ad3c-414d-a5ff-f02c854e881b service placement] REQUEST_METHOD: `GET` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 11 12:13:11.301198 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad4f55-ad3c-414d-a5ff-f02c854e881b service placement] SCRIPT_NAME: `/identity` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 11 12:13:11.301467 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad4f55-ad3c-414d-a5ff-f02c854e881b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 11 12:13:11.303391 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.fernet_utils [None req-9dad4f55-ad3c-414d-a5ff-f02c854e881b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 11 12:13:11.315338 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad4f55-ad3c-414d-a5ff-f02c854e881b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 11 12:13:11.316919 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad4f55-ad3c-414d-a5ff-f02c854e881b service placement] RBAC: Authorization granted {{(pid=81390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 11 12:13:11.327617 dv-cinder-820994-6-smb devstack@keystone.service[81390]: [pid: 81390|app: 0|req: 1320/2618] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 11 12:13:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 11 12:13:21.323002 dv-cinder-820994-6-smb devstack@keystone.service[81390]: DEBUG dbcounter [-] [81390] Writing DB stats keystone:SELECT=58 {{(pid=81390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}